You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Thomas Weise (Created) (JIRA)" <ji...@apache.org> on 2011/12/20 20:24:30 UTC

[jira] [Created] (HIVE-2665) Support for metastore specific HADOOP_OPTS environment setting

Support for metastore specific HADOOP_OPTS environment setting
--------------------------------------------------------------

                 Key: HIVE-2665
                 URL: https://issues.apache.org/jira/browse/HIVE-2665
             Project: Hive
          Issue Type: Improvement
          Components: Metastore
            Reporter: Thomas Weise
            Assignee: Thomas Weise
            Priority: Minor


For development/testing it would be helpful to have a way to define HADOOP_OPTS that apply only to a specific launcher and don't affect everything else launched through bin/hadoop. In this specific case I'm looking for a way to set metastore JVM debug options w/o modifying the HADOOP_OPTS environment setting or the hive scripts (which are replaced on every build).
 
  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-2665) Support for metastore service specific HADOOP_OPTS environment setting

Posted by "Thomas Weise (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Weise updated HIVE-2665:
-------------------------------

        Fix Version/s: 0.9.0
    Affects Version/s: 0.9.0
                       0.8.0
               Status: Patch Available  (was: Open)
    
> Support for metastore service specific HADOOP_OPTS environment setting
> ----------------------------------------------------------------------
>
>                 Key: HIVE-2665
>                 URL: https://issues.apache.org/jira/browse/HIVE-2665
>             Project: Hive
>          Issue Type: Improvement
>          Components: Metastore
>    Affects Versions: 0.8.0, 0.9.0
>            Reporter: Thomas Weise
>            Assignee: Thomas Weise
>            Priority: Minor
>             Fix For: 0.9.0
>
>         Attachments: HIVE-2665.patch
>
>
> For development/testing it would be helpful to have a way to define HADOOP_OPTS that apply only to a specific launcher and don't affect everything else launched through bin/hadoop. In this specific case I'm looking for a way to set metastore JVM debug options w/o modifying the HADOOP_OPTS environment setting or the hive scripts (which are replaced on every build).
>  
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2665) Support for metastore specific HADOOP_OPTS environment setting

Posted by "Thomas Weise (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13173454#comment-13173454 ] 

Thomas Weise commented on HIVE-2665:
------------------------------------

Would something like this be acceptable?

Index: bin/ext/metastore.sh
===================================================================
--- bin/ext/metastore.sh	(revision 1205535)
+++ bin/ext/metastore.sh	(working copy)
@@ -26,6 +26,7 @@
 
   # hadoop 20 or newer - skip the aux_jars option and hiveconf
 
+  export HADOOP_OPTS="$HIVE_METASTORE_HADOOP_OPTS $HADOOP_OPTS"
   exec $HADOOP jar $JAR $CLASS "$@"
 }

                
> Support for metastore specific HADOOP_OPTS environment setting
> --------------------------------------------------------------
>
>                 Key: HIVE-2665
>                 URL: https://issues.apache.org/jira/browse/HIVE-2665
>             Project: Hive
>          Issue Type: Improvement
>          Components: Metastore
>            Reporter: Thomas Weise
>            Assignee: Thomas Weise
>            Priority: Minor
>
> For development/testing it would be helpful to have a way to define HADOOP_OPTS that apply only to a specific launcher and don't affect everything else launched through bin/hadoop. In this specific case I'm looking for a way to set metastore JVM debug options w/o modifying the HADOOP_OPTS environment setting or the hive scripts (which are replaced on every build).
>  
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2665) Support for metastore service specific HADOOP_OPTS environment setting

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13193403#comment-13193403 ] 

Hudson commented on HIVE-2665:
------------------------------

Integrated in Hive-trunk-h0.21 #1219 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1219/])
    HIVE-2665 : Support for metastore service specific HADOOP_OPTS environment setting (thw via hashutosh)

hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1235845
Files : 
* /hive/trunk/bin/ext/metastore.sh

                
> Support for metastore service specific HADOOP_OPTS environment setting
> ----------------------------------------------------------------------
>
>                 Key: HIVE-2665
>                 URL: https://issues.apache.org/jira/browse/HIVE-2665
>             Project: Hive
>          Issue Type: Improvement
>          Components: Metastore
>    Affects Versions: 0.8.0, 0.9.0
>            Reporter: Thomas Weise
>            Assignee: Thomas Weise
>            Priority: Minor
>             Fix For: 0.9.0
>
>         Attachments: HIVE-2665.patch
>
>
> For development/testing it would be helpful to have a way to define HADOOP_OPTS that apply only to a specific launcher and don't affect everything else launched through bin/hadoop. In this specific case I'm looking for a way to set metastore JVM debug options w/o modifying the HADOOP_OPTS environment setting or the hive scripts (which are replaced on every build).
>  
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-2665) Support for metastore service specific HADOOP_OPTS environment setting

Posted by "Thomas Weise (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Weise updated HIVE-2665:
-------------------------------

    Summary: Support for metastore service specific HADOOP_OPTS environment setting  (was: Support for metastore specific HADOOP_OPTS environment setting)
    
> Support for metastore service specific HADOOP_OPTS environment setting
> ----------------------------------------------------------------------
>
>                 Key: HIVE-2665
>                 URL: https://issues.apache.org/jira/browse/HIVE-2665
>             Project: Hive
>          Issue Type: Improvement
>          Components: Metastore
>            Reporter: Thomas Weise
>            Assignee: Thomas Weise
>            Priority: Minor
>
> For development/testing it would be helpful to have a way to define HADOOP_OPTS that apply only to a specific launcher and don't affect everything else launched through bin/hadoop. In this specific case I'm looking for a way to set metastore JVM debug options w/o modifying the HADOOP_OPTS environment setting or the hive scripts (which are replaced on every build).
>  
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-2665) Support for metastore service specific HADOOP_OPTS environment setting

Posted by "Ashutosh Chauhan (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ashutosh Chauhan updated HIVE-2665:
-----------------------------------

    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

Committed to trunk. Thanks, Thomas!
                
> Support for metastore service specific HADOOP_OPTS environment setting
> ----------------------------------------------------------------------
>
>                 Key: HIVE-2665
>                 URL: https://issues.apache.org/jira/browse/HIVE-2665
>             Project: Hive
>          Issue Type: Improvement
>          Components: Metastore
>    Affects Versions: 0.8.0, 0.9.0
>            Reporter: Thomas Weise
>            Assignee: Thomas Weise
>            Priority: Minor
>             Fix For: 0.9.0
>
>         Attachments: HIVE-2665.patch
>
>
> For development/testing it would be helpful to have a way to define HADOOP_OPTS that apply only to a specific launcher and don't affect everything else launched through bin/hadoop. In this specific case I'm looking for a way to set metastore JVM debug options w/o modifying the HADOOP_OPTS environment setting or the hive scripts (which are replaced on every build).
>  
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-2665) Support for metastore service specific HADOOP_OPTS environment setting

Posted by "Thomas Weise (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Weise updated HIVE-2665:
-------------------------------

    Attachment: HIVE-2665.patch
    
> Support for metastore service specific HADOOP_OPTS environment setting
> ----------------------------------------------------------------------
>
>                 Key: HIVE-2665
>                 URL: https://issues.apache.org/jira/browse/HIVE-2665
>             Project: Hive
>          Issue Type: Improvement
>          Components: Metastore
>    Affects Versions: 0.8.0, 0.9.0
>            Reporter: Thomas Weise
>            Assignee: Thomas Weise
>            Priority: Minor
>             Fix For: 0.9.0
>
>         Attachments: HIVE-2665.patch
>
>
> For development/testing it would be helpful to have a way to define HADOOP_OPTS that apply only to a specific launcher and don't affect everything else launched through bin/hadoop. In this specific case I'm looking for a way to set metastore JVM debug options w/o modifying the HADOOP_OPTS environment setting or the hive scripts (which are replaced on every build).
>  
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2665) Support for metastore service specific HADOOP_OPTS environment setting

Posted by "Ashutosh Chauhan (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13192752#comment-13192752 ] 

Ashutosh Chauhan commented on HIVE-2665:
----------------------------------------

+1 Running tests.
                
> Support for metastore service specific HADOOP_OPTS environment setting
> ----------------------------------------------------------------------
>
>                 Key: HIVE-2665
>                 URL: https://issues.apache.org/jira/browse/HIVE-2665
>             Project: Hive
>          Issue Type: Improvement
>          Components: Metastore
>    Affects Versions: 0.8.0, 0.9.0
>            Reporter: Thomas Weise
>            Assignee: Thomas Weise
>            Priority: Minor
>             Fix For: 0.9.0
>
>         Attachments: HIVE-2665.patch
>
>
> For development/testing it would be helpful to have a way to define HADOOP_OPTS that apply only to a specific launcher and don't affect everything else launched through bin/hadoop. In this specific case I'm looking for a way to set metastore JVM debug options w/o modifying the HADOOP_OPTS environment setting or the hive scripts (which are replaced on every build).
>  
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2665) Support for metastore service specific HADOOP_OPTS environment setting

Posted by "Ashutosh Chauhan (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13190266#comment-13190266 ] 

Ashutosh Chauhan commented on HIVE-2665:
----------------------------------------

I agree, something like this will be useful, since munging with HADOOP_OPTS can have undesired effects.
                
> Support for metastore service specific HADOOP_OPTS environment setting
> ----------------------------------------------------------------------
>
>                 Key: HIVE-2665
>                 URL: https://issues.apache.org/jira/browse/HIVE-2665
>             Project: Hive
>          Issue Type: Improvement
>          Components: Metastore
>            Reporter: Thomas Weise
>            Assignee: Thomas Weise
>            Priority: Minor
>
> For development/testing it would be helpful to have a way to define HADOOP_OPTS that apply only to a specific launcher and don't affect everything else launched through bin/hadoop. In this specific case I'm looking for a way to set metastore JVM debug options w/o modifying the HADOOP_OPTS environment setting or the hive scripts (which are replaced on every build).
>  
>   

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira