You are viewing a plain text version of this content. The canonical link for it is here.
Posted to general@hadoop.apache.org by Vitaliy Avdeev <va...@xasax.net> on 2009/10/16 15:26:03 UTC
Hadoop and org.apache.hadoop.conf.Configuration class.
Hello. I have such situation. I neet to write gui on Java for editing
core-site.xml.
For getting an editing data I am using org.apache.hadoop.conf.Configuration
class.
But when i saving data from it such with writeXML() method atributes such as
<finaly>true</finaly> are lost.
Is org.apache.hadoop.conf.Configuration supports such atributes?
Re: Hadoop and org.apache.hadoop.conf.Configuration class.
Posted by Arun C Murthy <ac...@yahoo-inc.com>.
https://issues.apache.org/jira/browse/HADOOP-6317
Arun
On Oct 16, 2009, at 9:56 AM, Arun C Murthy wrote:
>
> On Oct 16, 2009, at 9:20 AM, Vitaliy Avdeev wrote:
>
>> Yes I meant final.
>> But why when I am using Configuration.writeXML(out) there is no
>> <final>
>> parameters in saved file?
>
> This was a conscious decision we made in HADOOP-785.
>
> The idea is that a Configuration is serialized from the 'client
> context'. The client configuration is always loaded on 'top' of the
> configuration stack at runtime on the server (either at the
> JobTracker on job-submission or at the TaskTracker during task-
> execution) and thus the notion of 'final' parameters is moot.
>
> Having said that you do have a valid cause for complaint; I've
> recently been involved in some discussions with the Pig team where
> we concluded that this feature could be useful during task
> localization on the TaskTracker i.e. the TaskTracker should set the
> 'localized' parameters of the task to be 'final'. The short end of
> the stick is I'd request you to open a jira asking for this
> enhancement... please?
>
> thanks,
> Arun
>
Re: Hadoop and org.apache.hadoop.conf.Configuration class.
Posted by Arun C Murthy <ac...@yahoo-inc.com>.
On Oct 16, 2009, at 9:20 AM, Vitaliy Avdeev wrote:
> Yes I meant final.
> But why when I am using Configuration.writeXML(out) there is no
> <final>
> parameters in saved file?
This was a conscious decision we made in HADOOP-785.
The idea is that a Configuration is serialized from the 'client
context'. The client configuration is always loaded on 'top' of the
configuration stack at runtime on the server (either at the JobTracker
on job-submission or at the TaskTracker during task-execution) and
thus the notion of 'final' parameters is moot.
Having said that you do have a valid cause for complaint; I've
recently been involved in some discussions with the Pig team where we
concluded that this feature could be useful during task localization
on the TaskTracker i.e. the TaskTracker should set the 'localized'
parameters of the task to be 'final'. The short end of the stick is
I'd request you to open a jira asking for this enhancement... please?
thanks,
Arun
Re: Hadoop and org.apache.hadoop.conf.Configuration class.
Posted by Philip Zeyliger <ph...@cloudera.com>.
I looked at the code: you're right in what you're
seeing---Configuration.writeXml doesn't write the final attribute.
It's mostly used for serialization a job's configuration when
necessary, and it doesn't need to preserve final in that context.
-- Philip
On Fri, Oct 16, 2009 at 9:20 AM, Vitaliy Avdeev <va...@xasax.net> wrote:
> Yes I meant final.
> But why when I am using Configuration.writeXML(out) there is no <final>
> parameters in saved file?
>
> On Fri, Oct 16, 2009 at 7:10 PM, Philip Zeyliger <ph...@cloudera.com>wrote:
>
>> I think you meant to use "<final>", not "finaly". See the "Final
>> Parameters" section of
>>
>> http://hadoop.apache.org/common/docs/r0.20.1/api/org/apache/hadoop/conf/Configuration.html
>> .
>>
>> On Fri, Oct 16, 2009 at 6:26 AM, Vitaliy Avdeev <va...@xasax.net> wrote:
>> > Hello. I have such situation. I neet to write gui on Java for editing
>> > core-site.xml.
>> > For getting an editing data I am using
>> org.apache.hadoop.conf.Configuration
>> > class.
>> > But when i saving data from it such with writeXML() method atributes such
>> as
>> > <finaly>true</finaly> are lost.
>> > Is org.apache.hadoop.conf.Configuration supports such atributes?
>> >
>>
>
Re: Hadoop and org.apache.hadoop.conf.Configuration class.
Posted by Vitaliy Avdeev <va...@xasax.net>.
Yes I meant final.
But why when I am using Configuration.writeXML(out) there is no <final>
parameters in saved file?
On Fri, Oct 16, 2009 at 7:10 PM, Philip Zeyliger <ph...@cloudera.com>wrote:
> I think you meant to use "<final>", not "finaly". See the "Final
> Parameters" section of
>
> http://hadoop.apache.org/common/docs/r0.20.1/api/org/apache/hadoop/conf/Configuration.html
> .
>
> On Fri, Oct 16, 2009 at 6:26 AM, Vitaliy Avdeev <va...@xasax.net> wrote:
> > Hello. I have such situation. I neet to write gui on Java for editing
> > core-site.xml.
> > For getting an editing data I am using
> org.apache.hadoop.conf.Configuration
> > class.
> > But when i saving data from it such with writeXML() method atributes such
> as
> > <finaly>true</finaly> are lost.
> > Is org.apache.hadoop.conf.Configuration supports such atributes?
> >
>
Re: Hadoop and org.apache.hadoop.conf.Configuration class.
Posted by Philip Zeyliger <ph...@cloudera.com>.
I think you meant to use "<final>", not "finaly". See the "Final
Parameters" section of
http://hadoop.apache.org/common/docs/r0.20.1/api/org/apache/hadoop/conf/Configuration.html
.
On Fri, Oct 16, 2009 at 6:26 AM, Vitaliy Avdeev <va...@xasax.net> wrote:
> Hello. I have such situation. I neet to write gui on Java for editing
> core-site.xml.
> For getting an editing data I am using org.apache.hadoop.conf.Configuration
> class.
> But when i saving data from it such with writeXML() method atributes such as
> <finaly>true</finaly> are lost.
> Is org.apache.hadoop.conf.Configuration supports such atributes?
>