You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Colin Son (JIRA)" <ji...@apache.org> on 2017/10/24 23:02:00 UTC
[jira] [Created] (AIRFLOW-1756) S3 Task Handler Cannot Read Logs
With New S3Hook
Colin Son created AIRFLOW-1756:
----------------------------------
Summary: S3 Task Handler Cannot Read Logs With New S3Hook
Key: AIRFLOW-1756
URL: https://issues.apache.org/jira/browse/AIRFLOW-1756
Project: Apache Airflow
Issue Type: Bug
Affects Versions: 1.9.0
Reporter: Colin Son
With the changes to the S3Hook, it seems like it cannot read the S3 task logs. This is because the Key object is no longer an object.
In the `s3_read` in the S3TaskHandler.py:
{code}
s3_key = self.hook.get_key(remote_log_location)
if s3_key:
return s3_key.get_contents_as_string().decode()
{code}
Since the s3_key object is now a dict, you cannot call `get_contents_as_string()` on a dict object. You have to use the S3Hook's `read_key()` method to read the contents of the task logs now.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)