You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Ali Uz (JIRA)" <ji...@apache.org> on 2017/02/26 19:42:45 UTC
[jira] [Commented] (AIRFLOW-918) Improve bulk_load function for
MySqlHook
[ https://issues.apache.org/jira/browse/AIRFLOW-918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15884886#comment-15884886 ]
Ali Uz commented on AIRFLOW-918:
--------------------------------
It also looks like the function has not changed in version 1.8
> Improve bulk_load function for MySqlHook
> ----------------------------------------
>
> Key: AIRFLOW-918
> URL: https://issues.apache.org/jira/browse/AIRFLOW-918
> Project: Apache Airflow
> Issue Type: Improvement
> Components: hooks
> Affects Versions: Airflow 1.7.1.3
> Reporter: Ali Uz
> Priority: Minor
> Labels: easyfix, patch
>
> I think we can improve the `bulk_load` function in MySqlHook by adding a few more parameters. For example, if I want to run a LOAD DATA command like the following:
> ```
> LOAD DATA LOCAL INFILE 'abc.csv' INTO TABLE abc
> FIELDS TERMINATED BY ','
> ENCLOSED BY '"'
> LINES TERMINATED BY '\r\n'
> IGNORE 1 LINES
> ```
> I would expect to supply the delimiter parameters, enclosing quotes parameter, line terminating parameter and ignore line number parameter.
> The current function only applies the following command:
> ```
> LOAD DATA LOCAL INFILE 'abc.csv' INTO TABLE abc
> ```
> It would be great if we could extend it.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)