You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Jarek Jarcec Cecho (JIRA)" <ji...@apache.org> on 2012/10/22 03:16:13 UTC
[jira] [Commented] (SQOOP-638) Add an optional, simple and
extensible validation framework for sqoop
[ https://issues.apache.org/jira/browse/SQOOP-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13481111#comment-13481111 ]
Jarek Jarcec Cecho commented on SQOOP-638:
------------------------------------------
Hi Venkatesh,
it's quite big patch, would you mind to upload it to Apache Review Board (https://reviews.apache.org/) for easier review?
Jarcec
> Add an optional, simple and extensible validation framework for sqoop
> ---------------------------------------------------------------------
>
> Key: SQOOP-638
> URL: https://issues.apache.org/jira/browse/SQOOP-638
> Project: Sqoop
> Issue Type: Improvement
> Affects Versions: 1.4.2
> Reporter: Venkatesh Seetharam
> Assignee: Venkatesh Seetharam
> Priority: Minor
> Fix For: 1.4.2
>
> Attachments: SQOOP-638.patch
>
>
> Attempt to add an extensible validation framework to Sqoop. Adds an optional CLI option: --validate
> There are 3 basic interfaces:
> ValidationThreshold - Determines if the error margin between the source and target are acceptable: Absolute, Percentage Tolerant, etc.
> Default implementation is AbsoluteValidationThreshold which ensures the row counts from source and targets are the same.
> ValidationFailureHandler - Responsible for handling failures: log an error/warning, abort, etc. Default implementation logs a warning message to the configured logger.
> Validator - Drives the validation logic by delegating the decision to ValidationThreshold and delegating failure handling to ValidationFailureHandler. The default implementation comes with a RowCountValidator which validates the row counts from source and the target.
> You could extend these interfaces for more specific implementations and override 'em in sqoop configuration that is picked up.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira