You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Gwen Shapira (JIRA)" <ji...@apache.org> on 2014/08/27 19:29:59 UTC
[jira] [Commented] (KAFKA-934) kafka hadoop consumer and producer
use older 0.19.2 hadoop api's
[ https://issues.apache.org/jira/browse/KAFKA-934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112505#comment-14112505 ]
Gwen Shapira commented on KAFKA-934:
------------------------------------
Are we still maintaining those?
I thought these were no longer maintained since the community's preference is to use Camus.
If these are maintained, I have a long list of issues to add :)
> kafka hadoop consumer and producer use older 0.19.2 hadoop api's
> ----------------------------------------------------------------
>
> Key: KAFKA-934
> URL: https://issues.apache.org/jira/browse/KAFKA-934
> Project: Kafka
> Issue Type: Bug
> Components: contrib
> Affects Versions: 0.8.0
> Environment: [amilkowski@localhost impl]$ uname -a
> Linux localhost.localdomain 3.9.4-200.fc18.x86_64 #1 SMP Fri May 24 20:10:49 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux
> Reporter: Andrew Milkowski
> Assignee: Sriharsha Chintalapani
> Labels: hadoop, hadoop-2.0, newbie
> Fix For: 0.8.2
>
>
> New hadoop api present in 0.20.1 especially package org.apache.hadoop.mapredude.lib is not used
> code affected is both consumer and producer in kafka in the contrib package
> [amilkowski@localhost contrib]$ pwd
> /opt/local/git/kafka/contrib
> [amilkowski@localhost contrib]$ ls -lt
> total 12
> drwxrwxr-x 8 amilkowski amilkowski 4096 May 30 11:14 hadoop-consumer
> drwxrwxr-x 6 amilkowski amilkowski 4096 May 29 19:31 hadoop-producer
> drwxrwxr-x 6 amilkowski amilkowski 4096 May 29 16:43 target
> [amilkowski@localhost contrib]$
> in example
> import org.apache.hadoop.mapred.JobClient;
> import org.apache.hadoop.mapred.JobConf;
> import org.apache.hadoop.mapred.RunningJob;
> import org.apache.hadoop.mapred.TextOutputFormat;
> use 0.19.2 hadoop api format, this prevents merging of hadoop feature into more modern hadoop implementation
> instead of drawing from 0.20.1 api set in import org.apache.hadoop.mapreduce
--
This message was sent by Atlassian JIRA
(v6.2#6252)