You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Venkat Ranganathan (JIRA)" <ji...@apache.org> on 2014/11/19 08:25:33 UTC
[jira] [Commented] (SQOOP-1627) Fix Hadoop100 and Hadoop20 profile
[ https://issues.apache.org/jira/browse/SQOOP-1627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217547#comment-14217547 ]
Venkat Ranganathan commented on SQOOP-1627:
-------------------------------------------
There are other issues with both hadoop100 and hadoop20 profiles. We have the tests using Hadoop 2 specific class (and that is also not public :( - I committed the change as part of Sqlserver Upsert support.
There is another issue with Mainframe support change which is using the Job.getInstance() but only the deprecated method is available in Hadoop 1.x
And we have a HbaseConfiguration.merge used in HBaseImportJob that breaks the 20 profile.
May be we can decide the Hadoop 1.x and hadoop 20 profile are no longer supported. But I have added a patch to fix those. I have tested across the profiles
> Fix Hadoop100 and Hadoop20 profile
> -----------------------------------
>
> Key: SQOOP-1627
> URL: https://issues.apache.org/jira/browse/SQOOP-1627
> Project: Sqoop
> Issue Type: Bug
> Affects Versions: 1.4.6
> Environment: hadoop100 profile
> Reporter: Venkat Ranganathan
>
> ompile:
> [mkdir] Created dir: /home/jenkins/jenkins-slave/workspace/Sqoop-ant-jdk-1.6-hadoop100/build/classes
> [javac] /home/jenkins/jenkins-slave/workspace/Sqoop-ant-jdk-1.6-hadoop100/build.xml:526: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds
> [javac] Compiling 2 source files to /home/jenkins/jenkins-slave/workspace/Sqoop-ant-jdk-1.6-hadoop100/build/classes
> [javac] /home/jenkins/jenkins-slave/workspace/Sqoop-ant-jdk-1.6-hadoop100/build.xml:539: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds
> [javac] Compiling 468 source files to /home/jenkins/jenkins-slave/workspace/Sqoop-ant-jdk-1.6-hadoop100/build/classes
> [javac] /home/jenkins/jenkins-slave/workspace/Sqoop-ant-jdk-1.6-hadoop100/src/java/org/apache/sqoop/mapreduce/mainframe/MainframeDatasetImportMapper.java:29: cannot find symbol
> [javac] symbol : class MultipleOutputs
> [javac] location: package org.apache.hadoop.mapreduce.lib.output
> [javac] import org.apache.hadoop.mapreduce.lib.output.MultipleOutputs;
> [javac] ^
> [javac] /home/jenkins/jenkins-slave/workspace/Sqoop-ant-jdk-1.6-hadoop100/src/java/org/apache/sqoop/mapreduce/mainframe/MainframeDatasetImportMapper.java:46: cannot find symbol
> [javac] symbol : class MultipleOutputs
> [javac] location: class org.apache.sqoop.mapreduce.mainframe.MainframeDatasetImportMapper
> [javac] private MultipleOutputs<Text, NullWritable> mos;
> [javac] ^
> [javac] /home/jenkins/jenkins-slave/workspace/Sqoop-ant-jdk-1.6-hadoop100/src/java/org/apache/sqoop/mapreduce/mainframe/MainframeImportJob.java:27: cannot find symbol
> [javac] symbol : class LazyOutputFormat
> [javac] location: package org.apache.hadoop.mapreduce.lib.output
> [javac] import org.apache.hadoop.mapreduce.lib.output.LazyOutputFormat;
> [javac] ^
> [javac] org/kitesdk/data/mapreduce/DatasetKeyInputFormat.class(org/kitesdk/data/mapreduce:DatasetKeyInputFormat.class): warning: Cannot find annotation method 'value()' in type 'edu.umd.cs.findbugs.annotations.SuppressWarnings': class file for edu.umd.cs.findbugs.annotations.SuppressWarnings not found
> [javac] org/kitesdk/data/mapreduce/DatasetKeyInputFormat.class(org/kitesdk/data/mapreduce:DatasetKeyInputFormat.class): warning: Cannot find annotation method 'justification()' in type 'edu.umd.cs.findbugs.annotations.SuppressWarnings'
> [javac] org/kitesdk/data/mapreduce/DatasetKeyInputFormat.class(org/kitesdk/data/mapreduce:DatasetKeyInputFormat.class): warning: Cannot find annotation method 'value()' in type 'edu.umd.cs.findbugs.annotations.SuppressWarnings'
> [javac] org/kitesdk/data/mapreduce/DatasetKeyInputFormat.class(org/kitesdk/data/mapreduce:DatasetKeyInputFormat.class): warning: Cannot find annotation method 'justification()' in type 'edu.umd.cs.findbugs.annotations.SuppressWarnings'
> [javac] /home/jenkins/jenkins-slave/workspace/Sqoop-ant-jdk-1.6-hadoop100/src/java/org/apache/sqoop/mapreduce/mainframe/MainframeDatasetImportMapper.java:63: cannot find symbol
> [javac] symbol : class MultipleOutputs
> [javac] location: class org.apache.sqoop.mapreduce.mainframe.MainframeDatasetImportMapper
> [javac] mos = new MultipleOutputs<Text, NullWritable>(context);
> [javac] ^
> [javac] /home/jenkins/jenkins-slave/workspace/Sqoop-ant-jdk-1.6-hadoop100/src/java/org/apache/sqoop/mapreduce/mainframe/MainframeImportJob.java:68: cannot find symbol
> [javac] symbol : variable LazyOutputFormat
> [javac] location: class org.apache.sqoop.mapreduce.mainframe.MainframeImportJob
> [javac] LazyOutputFormat.setOutputFormatClass(job, getOutputFormatClass());
> [javac] ^
> [javac] Note: Some input files use or override a deprecated API.
> [javac] Note: Recompile with -Xlint:deprecation for details.
> [javac] Note: Some input files use unchecked or unsafe operations.
> [javac] Note: Recompile with -Xlint:unchecked for details.
> [javac] 5 errors
> [javac] 4 warnings
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)