You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Sandhya E <sa...@gmail.com> on 2009/02/18 10:48:09 UTC
GenericOptionsParser warning
Hi All
I prepare my JobConf object in a java class, by calling various set
apis in JobConf object. When I submit the jobconf object using
JobClient.runJob(conf), I'm seeing the warning:
"Use GenericOptionsParser for parsing the arguments. Applications
should implement Tool for the same". From hadoop sources it looks like
setting "mapred.used.genericoptionsparser" will prevent this warning.
But if I set this flag to true, will it have some other side effects.
Thanks
Sandhya
Re: GenericOptionsParser warning
Posted by Steve Loughran <st...@apache.org>.
Rasit OZDAS wrote:
> Hi,
> There is a JIRA issue about this problem, if I understand it correctly:
> https://issues.apache.org/jira/browse/HADOOP-3743
>
> Strange, that I searched all source code, but there exists only this control
> in 2 places:
>
> if (!(job.getBoolean("mapred.used.genericoptionsparser", false))) {
> LOG.warn("Use GenericOptionsParser for parsing the arguments. " +
> "Applications should implement Tool for the same.");
> }
>
> Just an if block for logging, no extra controls.
> Am I missing something?
>
> If your class implements Tool, than there shouldn't be a warning.
OK, for my automated submission code I'll just set that switch and I
won't get told off.
Re: GenericOptionsParser warning
Posted by Aaron Kimball <aa...@cloudera.com>.
You should put this stub code in your program as the means to start your
MapReduce job:
public class Foo extends Configured implements Tool {
public int run(String [] args) throws IOException {
JobConf conf = new JobConf(getConf(), Foo.class);
// run the job here.
return 0;
}
public static void main(String [] args) throws Exception {
int ret = ToolRunner.run(new Foo(), args); // calls your run() method.
System.exit(ret);
}
}
On Wed, Feb 18, 2009 at 7:09 AM, Rasit OZDAS <ra...@gmail.com> wrote:
> Hi,
> There is a JIRA issue about this problem, if I understand it correctly:
> https://issues.apache.org/jira/browse/HADOOP-3743
>
> Strange, that I searched all source code, but there exists only this
> control
> in 2 places:
>
> if (!(job.getBoolean("mapred.used.genericoptionsparser", false))) {
> LOG.warn("Use GenericOptionsParser for parsing the arguments. " +
> "Applications should implement Tool for the same.");
> }
>
> Just an if block for logging, no extra controls.
> Am I missing something?
>
> If your class implements Tool, than there shouldn't be a warning.
>
> Cheers,
> Rasit
>
> 2009/2/18 Steve Loughran <st...@apache.org>
>
> > Sandhya E wrote:
> >
> >> Hi All
> >>
> >> I prepare my JobConf object in a java class, by calling various set
> >> apis in JobConf object. When I submit the jobconf object using
> >> JobClient.runJob(conf), I'm seeing the warning:
> >> "Use GenericOptionsParser for parsing the arguments. Applications
> >> should implement Tool for the same". From hadoop sources it looks like
> >> setting "mapred.used.genericoptionsparser" will prevent this warning.
> >> But if I set this flag to true, will it have some other side effects.
> >>
> >> Thanks
> >> Sandhya
> >>
> >
> > Seen this message too -and it annoys me; not tracked it down
> >
>
>
>
> --
> M. Raşit ÖZDAŞ
>
Re: GenericOptionsParser warning
Posted by Rasit OZDAS <ra...@gmail.com>.
Hi,
There is a JIRA issue about this problem, if I understand it correctly:
https://issues.apache.org/jira/browse/HADOOP-3743
Strange, that I searched all source code, but there exists only this control
in 2 places:
if (!(job.getBoolean("mapred.used.genericoptionsparser", false))) {
LOG.warn("Use GenericOptionsParser for parsing the arguments. " +
"Applications should implement Tool for the same.");
}
Just an if block for logging, no extra controls.
Am I missing something?
If your class implements Tool, than there shouldn't be a warning.
Cheers,
Rasit
2009/2/18 Steve Loughran <st...@apache.org>
> Sandhya E wrote:
>
>> Hi All
>>
>> I prepare my JobConf object in a java class, by calling various set
>> apis in JobConf object. When I submit the jobconf object using
>> JobClient.runJob(conf), I'm seeing the warning:
>> "Use GenericOptionsParser for parsing the arguments. Applications
>> should implement Tool for the same". From hadoop sources it looks like
>> setting "mapred.used.genericoptionsparser" will prevent this warning.
>> But if I set this flag to true, will it have some other side effects.
>>
>> Thanks
>> Sandhya
>>
>
> Seen this message too -and it annoys me; not tracked it down
>
--
M. Raşit ÖZDAŞ
Re: GenericOptionsParser warning
Posted by Steve Loughran <st...@apache.org>.
Sandhya E wrote:
> Hi All
>
> I prepare my JobConf object in a java class, by calling various set
> apis in JobConf object. When I submit the jobconf object using
> JobClient.runJob(conf), I'm seeing the warning:
> "Use GenericOptionsParser for parsing the arguments. Applications
> should implement Tool for the same". From hadoop sources it looks like
> setting "mapred.used.genericoptionsparser" will prevent this warning.
> But if I set this flag to true, will it have some other side effects.
>
> Thanks
> Sandhya
Seen this message too -and it annoys me; not tracked it down