You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@sqoop.apache.org by "javalover123 (JIRA)" <ji...@apache.org> on 2016/08/18 10:47:20 UTC

[jira] [Commented] (SQOOP-3000) Export hive to crate is much more slow than mysql

    [ https://issues.apache.org/jira/browse/SQOOP-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15426251#comment-15426251 ] 

javalover123 commented on SQOOP-3000:
-------------------------------------

sqoop export --connect jdbc:crate://10.1.136.125:4300 --driver io.crate.client.jdbc.CrateDriver --table dm_list_play_d --export-dir /user/hive/warehouse/temp.db/dm_list_play_d_crate/dt=2016-07-30*/* --fields-terminated-by '|' --null-non-string '' --null-string '' --input-null-non-string '\\N' --input-null-string '\\N'

> Export hive to crate is much more slow than mysql
> -------------------------------------------------
>
>                 Key: SQOOP-3000
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3000
>             Project: Sqoop
>          Issue Type: Improvement
>    Affects Versions: 1.4.5
>         Environment: hadoop-2.7.1 on yarn
>            Reporter: javalover123
>
> Export 16 million row to mysql cost less than 10 minute，export to crate cost more than 70 minute.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)