You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Ali Uz (JIRA)" <ji...@apache.org> on 2017/02/26 19:42:45 UTC

[jira] [Commented] (AIRFLOW-918) Improve bulk_load function for MySqlHook

    [ https://issues.apache.org/jira/browse/AIRFLOW-918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15884886#comment-15884886 ] 

Ali Uz commented on AIRFLOW-918:
--------------------------------

It also looks like the function has not changed in version 1.8

> Improve bulk_load function for MySqlHook
> ----------------------------------------
>
>                 Key: AIRFLOW-918
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-918
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: hooks
>    Affects Versions: Airflow 1.7.1.3
>            Reporter: Ali Uz
>            Priority: Minor
>              Labels: easyfix, patch
>
> I think we can improve the `bulk_load` function in MySqlHook by adding a few more parameters. For example, if I want to run a LOAD DATA command like the following:
> ```
> LOAD DATA LOCAL INFILE 'abc.csv' INTO TABLE abc
> FIELDS TERMINATED BY ',' 
> ENCLOSED BY '"' 
> LINES TERMINATED BY '\r\n'
> IGNORE 1 LINES
> ```
> I would expect to supply the delimiter parameters, enclosing quotes parameter, line terminating parameter and ignore line number parameter.
> The current function only applies the following command:
> ```
> LOAD DATA LOCAL INFILE 'abc.csv' INTO TABLE abc
> ```
> It would be great if we could extend it.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)