[jira] [Updated] (AIRFLOW-4077) Using gevent worker class breaks reading remote log from s3

["Aizhamal Nurmamat kyzy (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/AIRFLOW-4077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aizhamal Nurmamat kyzy updated AIRFLOW-4077:
--------------------------------------------
         Labels: S3 gevent logging webapp worker  (was: S3 gevent logging worker)
    Component/s:     (was: worker)
                     (was: webapp)
                     (was: logging)
                 ui

Moving to ui component as part of component refactor. Webapp component will be removed.

> Using gevent worker class breaks reading remote log from s3
> -----------------------------------------------------------
>
>                 Key: AIRFLOW-4077
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-4077
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: ui
>    Affects Versions: 1.10.2
>         Environment: Local - Ubuntu
> Production - AWS Elastic Beanstalk
>            Reporter: Sanjay Hallan
>            Assignee: Tom
>            Priority: Major
>              Labels: S3, gevent, logging, webapp, worker
>
> We have been writing our airflow logs to S3 for quite sometime now successfully, using the worker class 'sync' which is the default. Viewing logs via the airflow UI works perfectly, in the sense that logs are read from the remote s3 location.
> When switching the worker class to gevent, the airflow UI no longer attempts to read the logs from the remote s3 location, rather it always attempts to read the logs from the file and as we are using a containerized environment reading log files in this way fails.
> Switching only the worker class back to sync and leaving all other airflow configuration untouched resolves this issue.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)