You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Veena Basavaraj (JIRA)" <ji...@apache.org> on 2015/03/06 17:46:39 UTC
[jira] [Resolved] (SQOOP-1666) Sqoop2: JobManager code on failure
should call SqoopDestroyerExecutor
[ https://issues.apache.org/jira/browse/SQOOP-1666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Veena Basavaraj resolved SQOOP-1666.
------------------------------------
Resolution: Fixed
Closing this since it is more work to refactor to reuse the few lines of code. Each of them independently work better.
> Sqoop2: JobManager code on failure should call SqoopDestroyerExecutor
> ----------------------------------------------------------------------
>
> Key: SQOOP-1666
> URL: https://issues.apache.org/jira/browse/SQOOP-1666
> Project: Sqoop
> Issue Type: Bug
> Reporter: Veena Basavaraj
> Labels: code-cleanup
> Fix For: 2.0.0
>
>
> There is more to just calling the destroyer.destroy method in the SqoopDestroyerExecutor
> Should not the code in JobManger call this utility class?
> The matching code is missing in the JobManager
> {code}
> public static void executeDestroyer(boolean success, Configuration configuration, Direction direction) {
> String destroyerPropertyName, prefixPropertyName;
> switch (direction) {
> default:
> case FROM:
> destroyerPropertyName = MRJobConstants.JOB_ETL_FROM_DESTROYER;
> prefixPropertyName = MRJobConstants.PREFIX_CONNECTOR_FROM_CONTEXT;
> break;
> case TO:
> destroyerPropertyName = MRJobConstants.JOB_ETL_TO_DESTROYER;
> prefixPropertyName = MRJobConstants.PREFIX_CONNECTOR_TO_CONTEXT;
> break;
> }
> Destroyer destroyer = (Destroyer) ClassUtils.instantiate(configuration.get(destroyerPropertyName));
> if(destroyer == null) {
> LOG.info("Skipping running destroyer as non was defined.");
> return;
> }
> // Objects that should be pass to the Destroyer execution
> PrefixContext subContext = new PrefixContext(configuration, prefixPropertyName);
> Object configConnection = MRConfigurationUtils.getConnectorConnectionConfig(direction, configuration);
> Object configJob = MRConfigurationUtils.getConnectorJobConfig(direction, configuration);
> // Propagate connector schema in every case for now
> Matcher matcher = MatcherFactory.getMatcher(
> MRConfigurationUtils.getConnectorSchema(Direction.FROM, configuration),
> MRConfigurationUtils.getConnectorSchema(Direction.TO, configuration));
> Schema schema = direction == Direction.FROM ?
> matcher.getFromSchema() : matcher.getToSchema();
> DestroyerContext destroyerContext = new DestroyerContext(subContext, success, schema);
> LOG.info("Executing destroyer class " + destroyer.getClass());
> destroyer.destroy(destroyerContext, configConnection, configJob);
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)