You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Jeff Zhang (JIRA)" <ji...@apache.org> on 2015/01/21 10:57:35 UTC
[jira] [Comment Edited] (TEZ-1826) Add option to disable split
grouping and local mode option for tez-examples
[ https://issues.apache.org/jira/browse/TEZ-1826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14285430#comment-14285430 ]
Jeff Zhang edited comment on TEZ-1826 at 1/21/15 9:57 AM:
----------------------------------------------------------
[~sseth], Upload a new patch
bq. Move the hadoop option printing and tez common option print to TezExampleBase, each example just print the example usage.
{code}
private void _printUsage() {
printUsage();
System.err.println();
printExtraOptionsUsage(System.err);
System.err.println();
ToolRunner.printGenericCommandUsage(System.err);
}
{code}
Here's the usage message for orderedwordcount
{code}
Usage: orderedwordcount in out [numPartitions]
Tez example extra options supported are
-local run it in tez local mode, currently it can only access local file system in tez local mode, run it in distributed mode without this option
-disableSplitGrouping disable split grouping for MRInput, enable split grouping without this option.
The Tez example extra options usage syntax is
example_name [extra_options] [example_parameters]
Generic options supported are
-conf <configuration file> specify an application configuration file
-D <property=value> use value for given property
-fs <local|namenode:port> specify a namenode
-jt <local|resourcemanager:port> specify a ResourceManager
-files <comma separated list of files> specify comma separated files to be copied to the map reduce cluster
-libjars <comma separated list of jars> specify comma separated jar files to include in the classpath.
-archives <comma separated list of archives> specify comma separated archives to be unarchived on the compute machines.
The general command line syntax is
bin/hadoop command [genericOptions] [commandOptions]
{code}
bq. The local flag - It'll be good to add notes on this about the configuration being changed.
Add one line of log when the local flag is enabled.
was (Author: zjffdu):
[~sseth], Upload a new patch
bq. Move the hadoop option printing and tez common option print to TezExampleBase, each example just print the example usage.
{code}
private void _printUsage() {
printUsage();
System.err.println();
printExtraOptionsUsage(System.err);
System.err.println();
ToolRunner.printGenericCommandUsage(System.err);
}
{code}
Here's the usage message for orderedwordcount
{code}
Usage: orderedwordcount in out [numPartitions]
Tez example extra options supported are
-local run it in tez local mode, currently it can only access local file system in tez local mode, run it in distributed mode without this option
-disableSplitGrouping disable split grouping for MRInput, enable split grouping without this option.
The Tez example extra options usage syntax is
example_name [extra_options] [example_parameters]
Generic options supported are
-conf <configuration file> specify an application configuration file
-D <property=value> use value for given property
-fs <local|namenode:port> specify a namenode
-jt <local|resourcemanager:port> specify a ResourceManager
-files <comma separated list of files> specify comma separated files to be copied to the map reduce cluster
-libjars <comma separated list of jars> specify comma separated jar files to include in the classpath.
-archives <comma separated list of archives> specify comma separated archives to be unarchived on the compute machines.
The general command line syntax is
bin/hadoop command [genericOptions] [commandOptions]
{code}
* bq. The local flag - It'll be good to add notes on this about the configuration being changed.
Add one line of log when the local flag is enabled.
> Add option to disable split grouping and local mode option for tez-examples
> ---------------------------------------------------------------------------
>
> Key: TEZ-1826
> URL: https://issues.apache.org/jira/browse/TEZ-1826
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Siddharth Seth
> Assignee: Jeff Zhang
> Priority: Minor
> Attachments: TEZ-1826-1.patch, TEZ-1826-2.patch, TEZ-1826-3.patch, TEZ-1826-4.patch, TEZ-1826-5.patch
>
>
> In Wordcount for instance.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)