You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Mahadev konar (JIRA)" <ji...@apache.org> on 2006/05/30 20:42:30 UTC

[jira] Created: (HADOOP-260) the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines

the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines
--------------------------------------------------------------------------------------------------------------------------------------

         Key: HADOOP-260
         URL: http://issues.apache.org/jira/browse/HADOOP-260
     Project: Hadoop
        Type: Improvement

    Reporter: Mahadev konar
 Assigned to: Mahadev konar 
    Priority: Minor


--config paramter would allow getting rid of SSH_OPTS.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira


[jira] Commented: (HADOOP-260) the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines

Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
    [ http://issues.apache.org/jira/browse/HADOOP-260?page=comments#action_12413937 ] 

Mahadev konar commented on HADOOP-260:
--------------------------------------

you are right Doug. I will factor it out., so that it looks much cleaner. Thanks for the input.


> the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines
> --------------------------------------------------------------------------------------------------------------------------------------
>
>          Key: HADOOP-260
>          URL: http://issues.apache.org/jira/browse/HADOOP-260
>      Project: Hadoop
>         Type: Improvement

>     Reporter: Mahadev konar
>     Assignee: Mahadev konar
>     Priority: Minor
>  Attachments: config.patch
>
> --config paramter would allow getting rid of SSH_OPTS.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira


[jira] Commented: (HADOOP-260) the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
    [ http://issues.apache.org/jira/browse/HADOOP-260?page=comments#action_12422487 ] 
            
Milind Bhandarkar commented on HADOOP-260:
------------------------------------------

I have started looking at this issue. The original patch contains duplicate shell-script in all scripts. We could have separated it out as a function and included that file. However, in the meanwhile, the scripts have become portable across bourne-compatible shells, rather than being specific to bash. How do you propose we eliminate repeatition ?

> the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines
> --------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-260
>                 URL: http://issues.apache.org/jira/browse/HADOOP-260
>             Project: Hadoop
>          Issue Type: Improvement
>    Affects Versions: 0.2.0
>            Reporter: Mahadev konar
>         Assigned To: Mahadev konar
>            Priority: Minor
>             Fix For: 0.5.0
>
>         Attachments: config.patch
>
>
> --config paramter would allow getting rid of SSH_OPTS.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HADOOP-260) the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
     [ http://issues.apache.org/jira/browse/HADOOP-260?page=all ]

Milind Bhandarkar updated HADOOP-260:
-------------------------------------

    Attachment: hadoop-config.patch

Added a [--config confdir] optional parameter to all hadoop shell scripts. The scripts now use the portable source command to eliminate duplicate code.

> the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines
> --------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-260
>                 URL: http://issues.apache.org/jira/browse/HADOOP-260
>             Project: Hadoop
>          Issue Type: Improvement
>    Affects Versions: 0.2.0
>            Reporter: Mahadev konar
>         Assigned To: Mahadev konar
>            Priority: Minor
>             Fix For: 0.5.0
>
>         Attachments: hadoop-config.patch
>
>
> --config paramter would allow getting rid of SSH_OPTS.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HADOOP-260) the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines

Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
     [ http://issues.apache.org/jira/browse/HADOOP-260?page=all ]

Milind Bhandarkar updated HADOOP-260:
-------------------------------------

    Attachment:     (was: config.patch)

> the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines
> --------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-260
>                 URL: http://issues.apache.org/jira/browse/HADOOP-260
>             Project: Hadoop
>          Issue Type: Improvement
>    Affects Versions: 0.2.0
>            Reporter: Mahadev konar
>         Assigned To: Mahadev konar
>            Priority: Minor
>             Fix For: 0.5.0
>
>
> --config paramter would allow getting rid of SSH_OPTS.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HADOOP-260) the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines

Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
     [ http://issues.apache.org/jira/browse/HADOOP-260?page=all ]

Mahadev konar updated HADOOP-260:
---------------------------------

    Attachment: config.patch

This patch allows for a --config command line argument to all the scripts. It still works if HADOOP_CONF_DIR env variable is set and --config is not specified.

> the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines
> --------------------------------------------------------------------------------------------------------------------------------------
>
>          Key: HADOOP-260
>          URL: http://issues.apache.org/jira/browse/HADOOP-260
>      Project: Hadoop
>         Type: Improvement

>     Reporter: Mahadev konar
>     Assignee: Mahadev konar
>     Priority: Minor
>  Attachments: config.patch
>
> --config paramter would allow getting rid of SSH_OPTS.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira


Re: [jira] Commented: (HADOOP-260) the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines

Posted by Doug Cutting <cu...@apache.org>.
Can you please submit a new issue for this, rather than adding comments 
to a closed issue?  Thanks!

Doug

Vetle Roeim (JIRA) wrote:
>     [ http://issues.apache.org/jira/browse/HADOOP-260?page=comments#action_12428984 ] 
>             
> Vetle Roeim commented on HADOOP-260:
> ------------------------------------
> 
> As far as I can tell, it's still necessary to define a separate PID directory for this to work; the PID variable in hadoop-deamon.sh does not take the configuration directory into account. While having a separate PID directory per configuration is not a problem per se, it seems unnecessary.
> 
>> the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines
>> --------------------------------------------------------------------------------------------------------------------------------------
>>
>>                 Key: HADOOP-260
>>                 URL: http://issues.apache.org/jira/browse/HADOOP-260
>>             Project: Hadoop
>>          Issue Type: Improvement
>>    Affects Versions: 0.2.0
>>            Reporter: Mahadev konar
>>         Assigned To: Milind Bhandarkar
>>            Priority: Minor
>>             Fix For: 0.5.0
>>
>>         Attachments: hadoop-config.patch
>>
>>
>> --config paramter would allow getting rid of SSH_OPTS.
> 

[jira] Commented: (HADOOP-260) the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines

Posted by "Vetle Roeim (JIRA)" <ji...@apache.org>.
    [ http://issues.apache.org/jira/browse/HADOOP-260?page=comments#action_12428984 ] 
            
Vetle Roeim commented on HADOOP-260:
------------------------------------

As far as I can tell, it's still necessary to define a separate PID directory for this to work; the PID variable in hadoop-deamon.sh does not take the configuration directory into account. While having a separate PID directory per configuration is not a problem per se, it seems unnecessary.

> the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines
> --------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-260
>                 URL: http://issues.apache.org/jira/browse/HADOOP-260
>             Project: Hadoop
>          Issue Type: Improvement
>    Affects Versions: 0.2.0
>            Reporter: Mahadev konar
>         Assigned To: Milind Bhandarkar
>            Priority: Minor
>             Fix For: 0.5.0
>
>         Attachments: hadoop-config.patch
>
>
> --config paramter would allow getting rid of SSH_OPTS.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (HADOOP-260) the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines

Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
    [ http://issues.apache.org/jira/browse/HADOOP-260?page=comments#action_12413930 ] 

Doug Cutting commented on HADOOP-260:
-------------------------------------

I like what this does, but not particularly the way it is done.  Having the same 20 lines repeated in 10 files seems fragile to me.  Can we somehow instead put this logic in a single file that's included in all of the scripts?

> the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines
> --------------------------------------------------------------------------------------------------------------------------------------
>
>          Key: HADOOP-260
>          URL: http://issues.apache.org/jira/browse/HADOOP-260
>      Project: Hadoop
>         Type: Improvement

>     Reporter: Mahadev konar
>     Assignee: Mahadev konar
>     Priority: Minor
>  Attachments: config.patch
>
> --config paramter would allow getting rid of SSH_OPTS.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira


[jira] Resolved: (HADOOP-260) the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines

Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
     [ http://issues.apache.org/jira/browse/HADOOP-260?page=all ]

Doug Cutting resolved HADOOP-260.
---------------------------------

    Resolution: Fixed
      Assignee: Milind Bhandarkar  (was: Mahadev konar)

I just committed this.  Thanks, Milind!

> the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines
> --------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-260
>                 URL: http://issues.apache.org/jira/browse/HADOOP-260
>             Project: Hadoop
>          Issue Type: Improvement
>    Affects Versions: 0.2.0
>            Reporter: Mahadev konar
>         Assigned To: Milind Bhandarkar
>            Priority: Minor
>             Fix For: 0.5.0
>
>         Attachments: hadoop-config.patch
>
>
> --config paramter would allow getting rid of SSH_OPTS.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HADOOP-260) the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines

Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
     [ http://issues.apache.org/jira/browse/HADOOP-260?page=all ]

Doug Cutting updated HADOOP-260:
--------------------------------

    Fix Version: 0.5.0
                     (was: 0.4.0)

> the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines
> --------------------------------------------------------------------------------------------------------------------------------------
>
>          Key: HADOOP-260
>          URL: http://issues.apache.org/jira/browse/HADOOP-260
>      Project: Hadoop
>         Type: Improvement

>     Versions: 0.2.0
>     Reporter: Mahadev konar
>     Assignee: Mahadev konar
>     Priority: Minor
>      Fix For: 0.5.0
>  Attachments: config.patch
>
> --config paramter would allow getting rid of SSH_OPTS.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira


[jira] Updated: (HADOOP-260) the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines

Posted by "Sameer Paranjpye (JIRA)" <ji...@apache.org>.
     [ http://issues.apache.org/jira/browse/HADOOP-260?page=all ]

Sameer Paranjpye updated HADOOP-260:
------------------------------------

    Fix Version: 0.3
        Version: 0.2

> the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines
> --------------------------------------------------------------------------------------------------------------------------------------
>
>          Key: HADOOP-260
>          URL: http://issues.apache.org/jira/browse/HADOOP-260
>      Project: Hadoop
>         Type: Improvement

>     Versions: 0.2
>     Reporter: Mahadev konar
>     Assignee: Mahadev konar
>     Priority: Minor
>      Fix For: 0.3
>  Attachments: config.patch
>
> --config paramter would allow getting rid of SSH_OPTS.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira


[jira] Updated: (HADOOP-260) the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines

Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
     [ http://issues.apache.org/jira/browse/HADOOP-260?page=all ]

Doug Cutting updated HADOOP-260:
--------------------------------

    Fix Version: 0.4
                     (was: 0.3.0)

> the start up scripts should take a command line parameter --config making it easy to run multiple hadoop installation on same machines
> --------------------------------------------------------------------------------------------------------------------------------------
>
>          Key: HADOOP-260
>          URL: http://issues.apache.org/jira/browse/HADOOP-260
>      Project: Hadoop
>         Type: Improvement

>     Versions: 0.2
>     Reporter: Mahadev konar
>     Assignee: Mahadev konar
>     Priority: Minor
>      Fix For: 0.4
>  Attachments: config.patch
>
> --config paramter would allow getting rid of SSH_OPTS.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira