You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2018/06/01 19:37:00 UTC
[jira] [Commented] (AIRFLOW-2551) Encode binary data with base64
standard rather than base64 url
[ https://issues.apache.org/jira/browse/AIRFLOW-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16498452#comment-16498452 ]
ASF subversion and git services commented on AIRFLOW-2551:
----------------------------------------------------------
Commit 975a45b0246eb836d653c7210651ecc9590c6db4 in incubator-airflow's branch refs/heads/master from [~whynick1]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=975a45b ]
[AIRFLOW-2551] Encode binary data with base64 standard rather than base64 url
> Encode binary data with base64 standard rather than base64 url
> --------------------------------------------------------------
>
> Key: AIRFLOW-2551
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2551
> Project: Apache Airflow
> Issue Type: Bug
> Reporter: Hongyi Wang
> Assignee: Hongyi Wang
> Priority: Major
> Fix For: 2.0.0
>
>
> When we try to load mysql data into Google BigQuery (mysql -> gcs -> bq), there is a binary filed (uuid), which will cause BigQuery job failed, with message "_Could not decode base64 string to bytes. Field: uuid; Value: _gJbkmC1QTiS-zZ46uiHWg==_"
> This was caused by "_col_val = base64.urlsafe_b64encode(col_val)_" in mysql_to_gcs_operator.
> We should use "_standard_b64encode()_" instead.
> {quote}{{Base64url encoding is basically base64 encoding except they use non-reserved URL characters (e.g. – is used instead of + and _ is used instead of /) __ }}
> {quote}
> Related to [AIRFLOW-2169]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)