You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "jack (Jira)" <ji...@apache.org> on 2019/12/17 08:19:00 UTC
[jira] [Commented] (AIRFLOW-918) Improve bulk_load function for
MySqlHook
[ https://issues.apache.org/jira/browse/AIRFLOW-918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16997977#comment-16997977 ]
jack commented on AIRFLOW-918:
------------------------------
[~ash] can be closed as duplicate of https://issues.apache.org/jira/browse/AIRFLOW-5921
Also this is a child of https://issues.apache.org/jira/browse/AIRFLOW-3886
> Improve bulk_load function for MySqlHook
> ----------------------------------------
>
> Key: AIRFLOW-918
> URL: https://issues.apache.org/jira/browse/AIRFLOW-918
> Project: Apache Airflow
> Issue Type: Improvement
> Components: hooks
> Affects Versions: 1.7.1.3
> Reporter: Ali Uz
> Priority: Minor
> Labels: easyfix, patch
>
> I think we can improve the `bulk_load` function in MySqlHook by adding a few more parameters. For example, if I want to run a LOAD DATA command like the following:
> ```
> LOAD DATA LOCAL INFILE 'abc.csv' INTO TABLE abc
> FIELDS TERMINATED BY ','
> ENCLOSED BY '"'
> LINES TERMINATED BY '\r\n'
> IGNORE 1 LINES
> ```
> I would expect to supply the delimiter parameters, enclosing quotes parameter, line terminating parameter and ignore line number parameter.
> The current function only applies the following command:
> ```
> LOAD DATA LOCAL INFILE 'abc.csv' INTO TABLE abc
> ```
> It would be great if we could extend it.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)