You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Qiuzhuang Lian (JIRA)" <ji...@apache.org> on 2016/01/15 06:14:39 UTC

[jira] [Commented] (SQOOP-999) Support bulk load from HDFS to PostgreSQL using COPY ... FROM

    [ https://issues.apache.org/jira/browse/SQOOP-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15101215#comment-15101215 ] 

Qiuzhuang Lian commented on SQOOP-999:
--------------------------------------

With postgres copy delimiter as of ctrl+c like special char of \001, it would break hadoop job.xml syntax since XML 1.0 can not support ctrl+x char in its configurations. We have to encode this delimiter to work around copy.

> Support bulk load from HDFS to PostgreSQL using COPY ... FROM
> -------------------------------------------------------------
>
>                 Key: SQOOP-999
>                 URL: https://issues.apache.org/jira/browse/SQOOP-999
>             Project: Sqoop
>          Issue Type: New Feature
>          Components: connectors/postgresql
>    Affects Versions: 1.4.3
>         Environment: PostgreSQL
>            Reporter: Ruslan Al-Fakikh
>            Assignee: Masatake Iwasaki
>             Fix For: 1.4.4
>
>         Attachments: export-to-postgresql-with-copy.1.patch, export-to-postgresql-with-copy.patch
>
>
> Initially taken from here:
> https://issues.cloudera.org/browse/SQOOP-184
> As Cloudera site is no longer used:
> {quote}
> Sqoop currently supports bulk export from PostgreSQL but not bulk import. PostgreSQL support COPY <table> FROM <filename> syntax and readily accepts CSV data. We should support this so there is --direct support in both directions.
> {quote}
> A note from myself:
> the pg_bulkupload feature is already implemented:
> https://issues.apache.org/jira/browse/SQOOP-390
> pg_builupload is a third-party tool, I guess supporting COPY would be a better case.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)