You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Veena Basavaraj (JIRA)" <ji...@apache.org> on 2015/03/04 23:25:41 UTC
[jira] [Comment Edited] (SQOOP-1168) Sqoop2: Delta Fetch/ Merge (
formerly called Incremental Import )
[ https://issues.apache.org/jira/browse/SQOOP-1168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347586#comment-14347586 ]
Veena Basavaraj edited comment on SQOOP-1168 at 3/4/15 10:25 PM:
-----------------------------------------------------------------
Sure. Thats awesome [~jarcec]. I have marked the two tickets I am working on in progress. Probably you can help me testing them out and reviewing it soon. I can put up ETAs for it.
SQOOP-1949 is isolated and totally up for grabs. As per the current design it involves adding a config in HDFSConnector and then doing the append when that option is chosen.
Formerly sub task 1805 and its subtasks are independent pieces for supporting incremental write in JDBC, same approach needs configs. The most fun part of the task is able to set up a integration test case I believe to test these incremental changes.
[update]
So might be good to spin off a new ticket for that completely that does exhaustive testing. For now to parallelize the effort I have split them off from 1168.
What are your thoughts?
was (Author: vybs):
Sure. Thats awesome [~jarcec]. I have marked the two tickets I am working on in progress. Probably you can help me testing them out and reviewing it soon. I can put up ETAs for it.
SQOOP-1949 is isolated and totally up for grabs. As per the current design it involves adding a config in HDFSConnector and then doing the append when that option is chosen.
Similarly sub task 9 and 11 are independent pieces for supporting incremental write in JDBC, same approach needs configs. The most fun part of the task is able to set up a integration test case I believe to test these incremental changes. So might be good to spin off a new ticket for that completely.
What are your thoughts?
> Sqoop2: Delta Fetch/ Merge ( formerly called Incremental Import )
> -----------------------------------------------------------------
>
> Key: SQOOP-1168
> URL: https://issues.apache.org/jira/browse/SQOOP-1168
> Project: Sqoop
> Issue Type: Bug
> Reporter: Hari Shreedharan
> Assignee: Veena Basavaraj
> Fix For: 2.0.0
>
>
> The formal design wiki is here
> https://cwiki.apache.org/confluence/display/SQOOP/Delta+Fetch+and+Merge+Design
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)