You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Giuseppe Valente (Jira)" <ji...@apache.org> on 2022/02/24 22:38:00 UTC
[jira] [Commented] (HADOOP-8521) Port StreamInputFormat to new Map Reduce API
[ https://issues.apache.org/jira/browse/HADOOP-8521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17497774#comment-17497774 ]
Giuseppe Valente commented on HADOOP-8521:
------------------------------------------
I'm getting this stacktrace trying to use an input format based on the new API, is it supposed to work?
Exception in thread "main" java.lang.RuntimeException: class org.apache.hadoop.hbase.mapreduce.HFileInputFormat
not org.apache.hadoop.mapred.InputFormat
at org.apache.hadoop.conf.Configuration.setClass(Configuration.java:2712)
at org.apache.hadoop.mapred.JobConf.setInputFormat(JobConf.java:700)
at org.apache.hadoop.streaming.StreamJob.setJobConf(StreamJob.java:798)
at org.apache.hadoop.streaming.StreamJob.run(StreamJob.java:126)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
at org.apache.hadoop.streaming.HadoopStreaming.main(HadoopStreaming.java:50)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at org.apache.hadoop.util.RunJar.run(RunJar.java:318)
at org.apache.hadoop.util.RunJar.main(RunJar.java:232)
> Port StreamInputFormat to new Map Reduce API
> --------------------------------------------
>
> Key: HADOOP-8521
> URL: https://issues.apache.org/jira/browse/HADOOP-8521
> Project: Hadoop Common
> Issue Type: Improvement
> Components: streaming
> Affects Versions: 0.23.0
> Reporter: madhukara phatak
> Assignee: madhukara phatak
> Priority: Major
> Fix For: 3.0.0-alpha1
>
> Attachments: HADOOP-8521-1.patch, HADOOP-8521-2.patch, HADOOP-8521-3.patch, HADOOP-8521.patch
>
>
> As of now , hadoop streaming uses old Hadoop M/R API. This JIRA ports it to the new M/R API.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org