[jira] [Commented] (SQOOP-1378) Sqoop2: From/To: Refactor schema

["Hudson (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SQOOP-1378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166266#comment-14166266 ] 

Hudson commented on SQOOP-1378:
-------------------------------

ABORTED: Integrated in Sqoop2-hadoop200 #547 (See [https://builds.apache.org/job/Sqoop2-hadoop200/547/])
SQOOP-1378: Sqoop2: From/To: Refactor schema (abraham: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=2c20d920f4ab31ae97ba57952d17677146069b5c)
* shell/src/main/java/org/apache/sqoop/shell/utils/SubmissionDisplayer.java
* core/src/main/java/org/apache/sqoop/driver/JobManager.java
* connector/connector-hdfs/src/main/java/org/apache/sqoop/connector/hdfs/HdfsConnectorError.java
* connector/connector-hdfs/src/main/java/org/apache/sqoop/connector/hdfs/HdfsConnector.java
* connector/connector-hdfs/src/test/java/org/apache/sqoop/connector/hdfs/TestExtractor.java
* common/src/main/java/org/apache/sqoop/job/etl/ExtractorContext.java
* common/src/main/java/org/apache/sqoop/schema/SchemaMatchOption.java
* shell/src/main/resources/shell-resource.properties
* submission/mapreduce/src/main/java/org/apache/sqoop/submission/mapreduce/MapreduceSubmissionEngine.java
* connector/connector-sdk/src/main/java/org/apache/sqoop/connector/idf/CSVIntermediateDataFormat.java
* execution/mapreduce/src/main/java/org/apache/sqoop/job/mr/SqoopMapper.java
* common/src/main/java/org/apache/sqoop/schema/type/Column.java
* connector/connector-hdfs/src/main/java/org/apache/sqoop/connector/hdfs/HdfsInitializer.java
* common/src/main/java/org/apache/sqoop/json/SchemaBean.java
* execution/mapreduce/src/main/java/org/apache/sqoop/job/mr/ConfigurationUtils.java
* execution/mapreduce/src/main/java/org/apache/sqoop/job/mr/SqoopOutputFormatLoadExecutor.java
* common/src/main/java/org/apache/sqoop/schema/Schema.java
* common/src/main/java/org/apache/sqoop/json/SubmissionBean.java
* connector/connector-sdk/src/main/java/org/apache/sqoop/connector/idf/IntermediateDataFormat.java
* connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestExtractor.java
* docs/src/site/sphinx/Tools.rst
* common/src/test/java/org/apache/sqoop/json/util/TestSchemaSerialization.java
* connector/connector-sdk/src/main/java/org/apache/sqoop/connector/idf/matcher/NameMatcher.java
* common/src/main/java/org/apache/sqoop/schema/SchemaError.java
* common/src/main/java/org/apache/sqoop/json/util/SchemaSerialization.java
* connector/connector-sdk/src/test/java/org/apache/sqoop/connector/idf/TestCSVIntermediateDataFormat.java
* common/src/main/java/org/apache/sqoop/model/MSubmission.java
* connector/connector-sdk/src/main/java/org/apache/sqoop/connector/idf/matcher/LocationMatcher.java
* connector/connector-sdk/src/main/java/org/apache/sqoop/connector/idf/matcher/AbstractMatcher.java


> Sqoop2: From/To: Refactor schema
> --------------------------------
>
>                 Key: SQOOP-1378
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1378
>             Project: Sqoop
>          Issue Type: Sub-task
>            Reporter: Abraham Elmahrek
>            Assignee: Gwen Shapira
>             Fix For: from/to
>
>         Attachments: SQOOP-1378.0.patch, SQOOP-1378.1.patch, SQOOP-1378.2.patch, SQOOP-1378.3.patch, SQOOP-1378.4.patch, SQOOP-1378.5.patch
>
>
> Relational database systems, hierarchical databases, etc. tend to have a well defined schema. Key-value DBs, BigTable clones, etc. tend to have weakly defined schemas. In fact, a key-value datastore may not have any kind of schema (other than the fact is is key-value).
> Schemas seem like they are local to the connector and should not be needed by the framework. Or, there should be a common Schema format that every connector knows how to decipher.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)