You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Arun C Murthy (JIRA)" <ji...@apache.org> on 2007/04/30 21:43:16 UTC

[jira] Created: (HADOOP-1307) Documentation & classification of various configuration knobs

Documentation & classification of various configuration knobs
-------------------------------------------------------------

                 Key: HADOOP-1307
                 URL: https://issues.apache.org/jira/browse/HADOOP-1307
             Project: Hadoop
          Issue Type: Wish
          Components: documentation
            Reporter: Arun C Murthy


Given the ever-increasing number of configuration knobs for both dfs and mapred, it would be very useful in the long run to start and maintain up-to-date information (on the hadoop-wiki?) for these. While we are at it, it could be well worth the time to classify each as USER (must be overridden by user e.g. mapred.input/output.dir), BEGINNER, INTERMEDIATE, EXPERT (see HADOOP-1304) so as to clearly demarcate them.

Thoughts?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1307) Classification of various configuration knobs

Posted by "Andrzej Bialecki (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492778 ] 

Andrzej Bialecki  commented on HADOOP-1307:
-------------------------------------------

Could we perhaps extend the XML markup to include this information as an attribute (or subelement) on a property? I.e.

<property level="expert">
  <name>...</name>
  <value>..</value>
</property>

Or the less preferred:

<property>
  <name>...</name>
  <value>...</value>
  <level>expert</level>
</property>

> Classification of various configuration knobs
> ---------------------------------------------
>
>                 Key: HADOOP-1307
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1307
>             Project: Hadoop
>          Issue Type: Wish
>          Components: documentation
>            Reporter: Arun C Murthy
>
> Given the ever-increasing number of configuration knobs for both dfs and mapred, it would be very useful to classify each as EXPERT or not so as to clearly demarcate them. 
> Thoughts?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1307) Documentation & classification of various configuration knobs

Posted by "Michael Bieniosek (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492770 ] 

Michael Bieniosek commented on HADOOP-1307:
-------------------------------------------

I'd rather see HADOOP-785 implemented first, since that is a logical separation, while this is developers guessing which configurable variables are more important.

> Documentation & classification of various configuration knobs
> -------------------------------------------------------------
>
>                 Key: HADOOP-1307
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1307
>             Project: Hadoop
>          Issue Type: Wish
>          Components: documentation
>            Reporter: Arun C Murthy
>
> Given the ever-increasing number of configuration knobs for both dfs and mapred, it would be very useful in the long run to start and maintain up-to-date information (on the hadoop-wiki?) for these. While we are at it, it could be well worth the time to classify each as USER (must be overridden by user e.g. mapred.input/output.dir), BEGINNER, INTERMEDIATE, EXPERT (see HADOOP-1304) so as to clearly demarcate them.
> Thoughts?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1307) Documentation & classification of various configuration knobs

Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12492772 ] 

Doug Cutting commented on HADOOP-1307:
--------------------------------------

We already auto-generate HTML documenting all parameters.

http://lucene.apache.org/hadoop/hadoop-default.html

This is linked to from the javadoc.  E.g.:

http://lucene.apache.org/hadoop/api/overview-summary.html#overview_description

This could be more attractively formatted, and we could perhaps divide things into different categories (client, server, user, expert, etc.), but I'd rather keep generating such documentation from XML source if possible, so that it stays in sync.

The stylesheet that generates this table is in conf/configuration.xsl.


> Documentation & classification of various configuration knobs
> -------------------------------------------------------------
>
>                 Key: HADOOP-1307
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1307
>             Project: Hadoop
>          Issue Type: Wish
>          Components: documentation
>            Reporter: Arun C Murthy
>
> Given the ever-increasing number of configuration knobs for both dfs and mapred, it would be very useful in the long run to start and maintain up-to-date information (on the hadoop-wiki?) for these. While we are at it, it could be well worth the time to classify each as USER (must be overridden by user e.g. mapred.input/output.dir), BEGINNER, INTERMEDIATE, EXPERT (see HADOOP-1304) so as to clearly demarcate them.
> Thoughts?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1307) Classification of various configuration knobs

Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy updated HADOOP-1307:
----------------------------------

    Description: 
Given the ever-increasing number of configuration knobs for both dfs and mapred, it would be very useful to classify each as EXPERT or not so as to clearly demarcate them. 

Thoughts?

  was:
Given the ever-increasing number of configuration knobs for both dfs and mapred, it would be very useful in the long run to start and maintain up-to-date information (on the hadoop-wiki?) for these. While we are at it, it could be well worth the time to classify each as USER (must be overridden by user e.g. mapred.input/output.dir), BEGINNER, INTERMEDIATE, EXPERT (see HADOOP-1304) so as to clearly demarcate them.

Thoughts?

        Summary: Classification of various configuration knobs  (was: Documentation & classification of various configuration knobs)

Updated based on feedback by Doug/Michael, lets just shoot for expert/non-expert classification, keeping in mind HADOOP-785.

> Classification of various configuration knobs
> ---------------------------------------------
>
>                 Key: HADOOP-1307
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1307
>             Project: Hadoop
>          Issue Type: Wish
>          Components: documentation
>            Reporter: Arun C Murthy
>
> Given the ever-increasing number of configuration knobs for both dfs and mapred, it would be very useful to classify each as EXPERT or not so as to clearly demarcate them. 
> Thoughts?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.