You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Devendra Bhat (JIRA)" <ji...@apache.org> on 2017/11/17 04:40:00 UTC
[jira] [Commented] (MAPREDUCE-614) Streaming partitioner should
allow command, not just Java class
[ https://issues.apache.org/jira/browse/MAPREDUCE-614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16256463#comment-16256463 ]
Devendra Bhat commented on MAPREDUCE-614:
-----------------------------------------
I don't know most of the thing which you guys were saying but I want to express clearly what thing I want from this partitioner function.
I have been trying to study mapreduce with python and while using python I have to pass the python codes as command.
Can you please implement what you suggested about this "it might be easier to define a suitable partitioner command (when using shell tools it might be easier to output a string instead of a specific number for example)," as @Klass suggested above.
> Streaming partitioner should allow command, not just Java class
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-614
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-614
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Klaas Bosteels
>
> Since HADOOP-4842 got committed, Streaming allows both commands and Java classes to be specified as mapper, reducer, and combiner, but the {{-partitioner}} option is still limited to Java classes only. Allowing commands to be specified as partitioner as well would greatly improve the flexibility of Streaming programs.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org