You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Jarek Jarcec Cecho (JIRA)" <ji...@apache.org> on 2012/07/02 19:12:21 UTC
[jira] [Created] (SQOOP-512) Intermediate data representation
Jarek Jarcec Cecho created SQOOP-512:
----------------------------------------
Summary: Intermediate data representation
Key: SQOOP-512
URL: https://issues.apache.org/jira/browse/SQOOP-512
Project: Sqoop
Issue Type: Task
Affects Versions: 2.0.0
Reporter: Jarek Jarcec Cecho
Assignee: Jarek Jarcec Cecho
Fix For: 2.0.0
In sqoop2 connectors will supply their own map phase that will import data. Because this piece of code will be fully under connector maintenance, we need to agree on common intermediate (map output) data representation that will be shared across all connectors and in all cases.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (SQOOP-512) Intermediate data representation
Posted by "Jarek Jarcec Cecho (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13406490#comment-13406490 ]
Jarek Jarcec Cecho commented on SQOOP-512:
------------------------------------------
I've described possible formats on following wiki page:
https://cwiki.apache.org/confluence/display/SQOOP/Sqoop2+Intermediate+representation
> Intermediate data representation
> --------------------------------
>
> Key: SQOOP-512
> URL: https://issues.apache.org/jira/browse/SQOOP-512
> Project: Sqoop
> Issue Type: Task
> Affects Versions: 2.0.0
> Reporter: Jarek Jarcec Cecho
> Assignee: Jarek Jarcec Cecho
> Fix For: 2.0.0
>
>
> In sqoop2 connectors will supply their own map phase that will import data. Because this piece of code will be fully under connector maintenance, we need to agree on common intermediate (map output) data representation that will be shared across all connectors and in all cases.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (SQOOP-512) Intermediate data representation
Posted by "Jarek Jarcec Cecho (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13422550#comment-13422550 ]
Jarek Jarcec Cecho commented on SQOOP-512:
------------------------------------------
Candidate for intermediate data representation is available on the wiki page:
https://cwiki.apache.org/confluence/display/SQOOP/Sqoop2+Intermediate+representation#Sqoop2Intermediaterepresentation-Intermediateformatrepresentationproposal
> Intermediate data representation
> --------------------------------
>
> Key: SQOOP-512
> URL: https://issues.apache.org/jira/browse/SQOOP-512
> Project: Sqoop
> Issue Type: Task
> Affects Versions: 2.0.0
> Reporter: Jarek Jarcec Cecho
> Assignee: Jarek Jarcec Cecho
> Fix For: 2.0.0
>
>
> In sqoop2 connectors will supply their own map phase that will import data. Because this piece of code will be fully under connector maintenance, we need to agree on common intermediate (map output) data representation that will be shared across all connectors and in all cases.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (SQOOP-512) Intermediate data representation
Posted by "Jarek Jarcec Cecho (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jarek Jarcec Cecho resolved SQOOP-512.
--------------------------------------
Resolution: Fixed
We've agreed to go with proposal from linked wiki page with small addition - we will use some sort of class or interface to allow different formats in the future.
> Intermediate data representation
> --------------------------------
>
> Key: SQOOP-512
> URL: https://issues.apache.org/jira/browse/SQOOP-512
> Project: Sqoop
> Issue Type: Task
> Affects Versions: 2.0.0
> Reporter: Jarek Jarcec Cecho
> Assignee: Jarek Jarcec Cecho
> Fix For: 2.0.0
>
>
> In sqoop2 connectors will supply their own map phase that will import data. Because this piece of code will be fully under connector maintenance, we need to agree on common intermediate (map output) data representation that will be shared across all connectors and in all cases.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira