You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Ali Uz (JIRA)" <ji...@apache.org> on 2017/02/26 19:41:45 UTC

[jira] [Created] (AIRFLOW-918) Improve bulk_load function for MySqlHook

Ali Uz created AIRFLOW-918:
------------------------------

             Summary: Improve bulk_load function for MySqlHook
                 Key: AIRFLOW-918
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-918
             Project: Apache Airflow
          Issue Type: Improvement
          Components: hooks
    Affects Versions: Airflow 1.7.1.3
            Reporter: Ali Uz
            Priority: Minor


I think we can improve the `bulk_load` function in MySqlHook by adding a few more parameters. For example, if I want to run a LOAD DATA command like the following:

```
LOAD DATA LOCAL INFILE 'abc.csv' INTO TABLE abc
FIELDS TERMINATED BY ',' 
ENCLOSED BY '"' 
LINES TERMINATED BY '\r\n'
IGNORE 1 LINES
```

I would expect to supply the delimiter parameters, enclosing quotes parameter, line terminating parameter and ignore line number parameter.
The current function only applies the following command:

```
LOAD DATA LOCAL INFILE 'abc.csv' INTO TABLE abc
```

It would be great if we could extend it.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)