[jira] [Resolved] (AIRFLOW-5553) mysql_to_gcs.MySqlToGoogleCloudStorageOperator binary values cannot be encoded whenever a BQ schema is not explicitly specified

["Felix Uellendall (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/AIRFLOW-5553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Felix Uellendall resolved AIRFLOW-5553.
---------------------------------------
    Fix Version/s: 1.10.6
       Resolution: Fixed

> mysql_to_gcs.MySqlToGoogleCloudStorageOperator binary values cannot be encoded whenever a BQ schema is not explicitly specified
> -------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: AIRFLOW-5553
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5553
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: operators
>    Affects Versions: 1.10.3, 1.10.4, 1.10.5
>            Reporter: Nikolay Stoynov
>            Assignee: Nikolay Stoynov
>            Priority: Minor
>              Labels: easyfix
>             Fix For: 1.10.6
>
>
>  
> The MySqlGoogleCloudStorageOperator currently deals with `bytes` values. However, the way it detects when a value is of type `bytes` is dependent on the column type in the BQ schema provided.
> Therefore, whenever a BQ schema is not provided, the value is not dealt with and a serialization issue occurs:
> {noformat}
> [2018-10-11 17:59:36,056] INFO airflow.task.task_runner.bash_task_runner.BashTaskRunner _read_task_logs - Job 11906: Subtask my_subtask TypeError: Object of type 'bytes' is not JSON serializable{noformat}
> This should be a trivial fix but needs to be addressed so that the check for a bytes value is based on the type of the variable too.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)