You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Carl Steinbach (JIRA)" <ji...@apache.org> on 2011/03/02 01:56:36 UTC

[jira] Created: (HIVE-2020) Create a separate namespace for Hive variables

Create a separate namespace for Hive variables
----------------------------------------------

                 Key: HIVE-2020
                 URL: https://issues.apache.org/jira/browse/HIVE-2020
             Project: Hive
          Issue Type: Improvement
          Components: Query Processor
            Reporter: Carl Steinbach


Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.

This ticket encompasses the following enhancements:
* Create a separate namespace for managing Hive variables.
* Add support for setting variables on the command line via '-hivevar x=y'
* Add support for setting variables through the CLI via 'var x=y'
* Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'



-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "Vaibhav Aggarwal (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vaibhav Aggarwal updated HIVE-2020:
-----------------------------------

    Attachment: HIVE-2020-2.patch

> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>            Assignee: Vaibhav Aggarwal
>         Attachments: HIVE-2020-2.patch, HIVE-2020.patch
>
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'var x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13095918#comment-13095918 ] 

Hudson commented on HIVE-2020:
------------------------------

Integrated in Hive-trunk-h0.21 #928 (See [https://builds.apache.org/job/Hive-trunk-h0.21/928/])
    HIVE-2020. Create a separate namespace for Hive variables (Vaibhav Aggarwal via cws)

cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1164319
Files : 
* /hive/trunk/cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java
* /hive/trunk/cli/src/java/org/apache/hadoop/hive/cli/OptionsProcessor.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/VariableSubstitution.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/processors/SetProcessor.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
* /hive/trunk/ql/src/test/queries/clientpositive/set_variable_sub.q
* /hive/trunk/ql/src/test/results/clientpositive/set_variable_sub.q.out


> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>            Assignee: Vaibhav Aggarwal
>             Fix For: 0.8.0
>
>         Attachments: HIVE-2020-2.patch, HIVE-2020-3.patch, HIVE-2020.patch
>
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'set hivevar:x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach updated HIVE-2020:
---------------------------------

    Status: Open  (was: Patch Available)

> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>            Assignee: Vaibhav Aggarwal
>         Attachments: HIVE-2020.patch
>
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'var x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "Vaibhav Aggarwal (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vaibhav Aggarwal updated HIVE-2020:
-----------------------------------

    Status: Patch Available  (was: Open)

> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>            Assignee: Vaibhav Aggarwal
>         Attachments: HIVE-2020.patch
>
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'var x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13095951#comment-13095951 ] 

Hudson commented on HIVE-2020:
------------------------------

Integrated in Hive-0.8.0-SNAPSHOT-h0.21 #5 (See [https://builds.apache.org/job/Hive-0.8.0-SNAPSHOT-h0.21/5/])
    HIVE-2020. Create a separate namespace for Hive variables (Vaibhav Aggarwal via cws)

cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1164320
Files : 
* /hive/branches/branch-0.8/cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java
* /hive/branches/branch-0.8/cli/src/java/org/apache/hadoop/hive/cli/OptionsProcessor.java
* /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/parse/VariableSubstitution.java
* /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/processors/SetProcessor.java
* /hive/branches/branch-0.8/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
* /hive/branches/branch-0.8/ql/src/test/queries/clientpositive/set_variable_sub.q
* /hive/branches/branch-0.8/ql/src/test/results/clientpositive/set_variable_sub.q.out


> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>            Assignee: Vaibhav Aggarwal
>             Fix For: 0.8.0
>
>         Attachments: HIVE-2020-2.patch, HIVE-2020-3.patch, HIVE-2020.patch
>
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'set hivevar:x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "Vaibhav Aggarwal (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13081267#comment-13081267 ] 

Vaibhav Aggarwal commented on HIVE-2020:
----------------------------------------

New review request: https://reviews.apache.org/r/1324/

> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>            Assignee: Vaibhav Aggarwal
>         Attachments: HIVE-2020-2.patch, HIVE-2020.patch
>
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'var x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "Vaibhav Aggarwal (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vaibhav Aggarwal updated HIVE-2020:
-----------------------------------

    Attachment: HIVE-2020-3.patch

> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>            Assignee: Vaibhav Aggarwal
>         Attachments: HIVE-2020-2.patch, HIVE-2020-3.patch, HIVE-2020.patch
>
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'var x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "jiraposter@reviews.apache.org (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13084943#comment-13084943 ] 

jiraposter@reviews.apache.org commented on HIVE-2020:
-----------------------------------------------------


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/1324/#review1450
-----------------------------------------------------------


* The patch does not compile. Looks like it's missing the definition for the Substitution class. Why is this new class necessary? Why not build any new functionality into the VariableSubstitution class?
* This patch needs to add new testcases for the namespace prefixing.
* Why is the new namespace named "define"? If not "hivevar", can we at least use a noun instead of a verb?

- Carl


On 2011-08-08 22:44:45, Vaibhav Aggarwal wrote:
bq.  
bq.  -----------------------------------------------------------
bq.  This is an automatically generated e-mail. To reply, visit:
bq.  https://reviews.apache.org/r/1324/
bq.  -----------------------------------------------------------
bq.  
bq.  (Updated 2011-08-08 22:44:45)
bq.  
bq.  
bq.  Review request for hive and Carl Steinbach.
bq.  
bq.  
bq.  Summary
bq.  -------
bq.  
bq.  Create a separate namespace for Hive variables.
bq.  
bq.  Added support for:
bq.  
bq.  1. -d and --define;
bq.  2. set define:var=var_value; // To set the variable
bq.  3. set -v;
bq.  4. set define:var; // To print the variable
bq.  
bq.  Thanks
bq.  Vaibhav
bq.  
bq.  
bq.  This addresses bug HIVE-2020.
bq.      https://issues.apache.org/jira/browse/HIVE-2020
bq.  
bq.  
bq.  Diffs
bq.  -----
bq.  
bq.    cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java a2976b5 
bq.    cli/src/java/org/apache/hadoop/hive/cli/OptionsProcessor.java 90084ed 
bq.    ql/src/java/org/apache/hadoop/hive/ql/parse/VariableSubstitution.java e203dda 
bq.    ql/src/java/org/apache/hadoop/hive/ql/processors/SetProcessor.java 97fa1ab 
bq.    ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java 6a6e8e8 
bq.  
bq.  Diff: https://reviews.apache.org/r/1324/diff
bq.  
bq.  
bq.  Testing
bq.  -------
bq.  
bq.  
bq.  Thanks,
bq.  
bq.  Vaibhav
bq.  
bq.



> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>            Assignee: Vaibhav Aggarwal
>         Attachments: HIVE-2020-2.patch, HIVE-2020.patch
>
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'var x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HIVE-2020) Create a separate namespace for Hive variables

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach updated HIVE-2020:
---------------------------------

    Description: 
Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.

This ticket encompasses the following enhancements:
* Create a separate namespace for managing Hive variables.
* Add support for setting variables on the command line via '-hivevar x=y'
* Add support for setting variables through the CLI via 'var x=y'
* Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
* Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'



  was:
Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.

This ticket encompasses the following enhancements:
* Create a separate namespace for managing Hive variables.
* Add support for setting variables on the command line via '-hivevar x=y'
* Add support for setting variables through the CLI via 'var x=y'
* Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'




> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'var x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "jiraposter@reviews.apache.org (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13072011#comment-13072011 ] 

jiraposter@reviews.apache.org commented on HIVE-2020:
-----------------------------------------------------


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/1204/
-----------------------------------------------------------

Review request for hive.


Summary
-------

Create a separate option for Hive variable


This addresses bug HIVE-2020.
    https://issues.apache.org/jira/browse/HIVE-2020


Diffs
-----

  cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java 9fa7bc6 
  cli/src/java/org/apache/hadoop/hive/cli/DefaultPreprocessor.java PRE-CREATION 
  cli/src/java/org/apache/hadoop/hive/cli/KeyValue.java PRE-CREATION 
  cli/src/java/org/apache/hadoop/hive/cli/OptionsProcessor.java 90084ed 
  cli/src/java/org/apache/hadoop/hive/cli/Preprocessor.java PRE-CREATION 

Diff: https://reviews.apache.org/r/1204/diff


Testing
-------


Thanks,

Vaibhav



> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>            Assignee: Vaibhav Aggarwal
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'var x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "Vaibhav Aggarwal (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13080275#comment-13080275 ] 

Vaibhav Aggarwal commented on HIVE-2020:
----------------------------------------

I had a chat with Carl about this issue.
The following are the planned next steps:

1. Use VariableSubstitution instead of DefaultPreprocessor.
2. Add support for specifying variables as '${var_name}' only for now. (Already implemented)
3. Support set -v to clearly separate hive variables from hiveconf variables.
4. Support setting variables through command line as '-d x=y' OR '--define x=y' (Already implemented)

Thanks
Vaibhav

> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>            Assignee: Vaibhav Aggarwal
>         Attachments: HIVE-2020.patch
>
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'var x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "Vaibhav Aggarwal (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13071318#comment-13071318 ] 

Vaibhav Aggarwal commented on HIVE-2020:
----------------------------------------

I propose to use -d, --define to define Hive variables.
Amazon ElasticMapreduce is already using this notation for hive variables and variable substitution.

This approach would also clearly separate use of -hiveconf from -d or --define which would be used to purely set hive variables.

This would also maintain consistency for Hive users.

> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'var x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "Vaibhav Aggarwal (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vaibhav Aggarwal updated HIVE-2020:
-----------------------------------

    Status: Patch Available  (was: Open)

> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>            Assignee: Vaibhav Aggarwal
>         Attachments: HIVE-2020-2.patch, HIVE-2020-3.patch, HIVE-2020.patch
>
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'var x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13072545#comment-13072545 ] 

Carl Steinbach commented on HIVE-2020:
--------------------------------------

@Vaibav: Is this patch ready for review? If so, please attach the patch to this ticket and click "Submit Patch". Thanks.

> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>            Assignee: Vaibhav Aggarwal
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'var x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "Vaibhav Aggarwal (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vaibhav Aggarwal updated HIVE-2020:
-----------------------------------

    Status: Patch Available  (was: Open)

> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>            Assignee: Vaibhav Aggarwal
>         Attachments: HIVE-2020-2.patch, HIVE-2020.patch
>
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'var x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "jiraposter@reviews.apache.org (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13078474#comment-13078474 ] 

jiraposter@reviews.apache.org commented on HIVE-2020:
-----------------------------------------------------


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/1204/#review1273
-----------------------------------------------------------


This patch doesn't appear to address most of the issues described in HIVE-2020, which covers adding a separate namespace for variables that is distinct from hiveconf and environment/system properties. This patch also needs a testcase.


cli/src/java/org/apache/hadoop/hive/cli/DefaultPreprocessor.java
<https://reviews.apache.org/r/1204/#comment2906>

    Please extend/modify/use the code in org.apache.hadoop.hive.ql.parse.VariableSubstitution instead of adding this class.



cli/src/java/org/apache/hadoop/hive/cli/OptionsProcessor.java
<https://reviews.apache.org/r/1204/#comment2905>

    I think these two option definitions can be combined, e.g:
    
    .withArgName("key=value")
    .withLongOpt("define")
    .create("d");


- Carl


On 2011-07-27 21:07:40, Vaibhav Aggarwal wrote:
bq.  
bq.  -----------------------------------------------------------
bq.  This is an automatically generated e-mail. To reply, visit:
bq.  https://reviews.apache.org/r/1204/
bq.  -----------------------------------------------------------
bq.  
bq.  (Updated 2011-07-27 21:07:40)
bq.  
bq.  
bq.  Review request for hive.
bq.  
bq.  
bq.  Summary
bq.  -------
bq.  
bq.  Create a separate option for Hive variable
bq.  
bq.  
bq.  This addresses bug HIVE-2020.
bq.      https://issues.apache.org/jira/browse/HIVE-2020
bq.  
bq.  
bq.  Diffs
bq.  -----
bq.  
bq.    cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java 9fa7bc6 
bq.    cli/src/java/org/apache/hadoop/hive/cli/DefaultPreprocessor.java PRE-CREATION 
bq.    cli/src/java/org/apache/hadoop/hive/cli/KeyValue.java PRE-CREATION 
bq.    cli/src/java/org/apache/hadoop/hive/cli/OptionsProcessor.java 90084ed 
bq.    cli/src/java/org/apache/hadoop/hive/cli/Preprocessor.java PRE-CREATION 
bq.  
bq.  Diff: https://reviews.apache.org/r/1204/diff
bq.  
bq.  
bq.  Testing
bq.  -------
bq.  
bq.  
bq.  Thanks,
bq.  
bq.  Vaibhav
bq.  
bq.



> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>            Assignee: Vaibhav Aggarwal
>         Attachments: HIVE-2020.patch
>
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'var x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach updated HIVE-2020:
---------------------------------

    Status: Open  (was: Patch Available)

> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>            Assignee: Vaibhav Aggarwal
>         Attachments: HIVE-2020-2.patch, HIVE-2020.patch
>
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'var x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "jiraposter@reviews.apache.org (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13081268#comment-13081268 ] 

jiraposter@reviews.apache.org commented on HIVE-2020:
-----------------------------------------------------


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/1324/
-----------------------------------------------------------

Review request for hive and Carl Steinbach.


Summary
-------

Create a separate namespace for Hive variables.

Added support for:

1. -d and --define;
2. set define:var=var_value; // To set the variable
3. set -v;
4. set define:var; // To print the variable

Thanks
Vaibhav


This addresses bug HIVE-2020.
    https://issues.apache.org/jira/browse/HIVE-2020


Diffs
-----

  cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java a2976b5 
  cli/src/java/org/apache/hadoop/hive/cli/OptionsProcessor.java 90084ed 
  ql/src/java/org/apache/hadoop/hive/ql/parse/VariableSubstitution.java e203dda 
  ql/src/java/org/apache/hadoop/hive/ql/processors/SetProcessor.java 97fa1ab 
  ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java 6a6e8e8 

Diff: https://reviews.apache.org/r/1324/diff


Testing
-------


Thanks,

Vaibhav



> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>            Assignee: Vaibhav Aggarwal
>         Attachments: HIVE-2020-2.patch, HIVE-2020.patch
>
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'var x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "Vaibhav Aggarwal (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vaibhav Aggarwal updated HIVE-2020:
-----------------------------------

    Attachment: HIVE-2020.patch

> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>            Assignee: Vaibhav Aggarwal
>         Attachments: HIVE-2020.patch
>
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'var x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach updated HIVE-2020:
---------------------------------

       Resolution: Fixed
    Fix Version/s: 0.8.0
     Hadoop Flags: [Reviewed]
           Status: Resolved  (was: Patch Available)

Committed to branch-0.8 and trunk. Thanks Vaibhav!

> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>            Assignee: Vaibhav Aggarwal
>             Fix For: 0.8.0
>
>         Attachments: HIVE-2020-2.patch, HIVE-2020-3.patch, HIVE-2020.patch
>
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'set hivevar:x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "jiraposter@reviews.apache.org (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13088100#comment-13088100 ] 

jiraposter@reviews.apache.org commented on HIVE-2020:
-----------------------------------------------------


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/1607/
-----------------------------------------------------------

Review request for hive and Carl Steinbach.


Summary
-------

1. Added support  hivevar
2. Removed dependency on new class
3. Added test case


This addresses bug HIVE-2020.
    https://issues.apache.org/jira/browse/HIVE-2020


Diffs
-----

  cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java a2976b5 
  cli/src/java/org/apache/hadoop/hive/cli/OptionsProcessor.java 90084ed 
  ql/src/java/org/apache/hadoop/hive/ql/parse/VariableSubstitution.java e203dda 
  ql/src/java/org/apache/hadoop/hive/ql/processors/SetProcessor.java 97fa1ab 
  ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java 6a6e8e8 
  ql/src/test/queries/clientpositive/set_variable_sub.q PRE-CREATION 
  ql/src/test/results/clientpositive/set_variable_sub.q.out PRE-CREATION 

Diff: https://reviews.apache.org/r/1607/diff


Testing
-------


Thanks,

Vaibhav



> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>            Assignee: Vaibhav Aggarwal
>         Attachments: HIVE-2020-2.patch, HIVE-2020-3.patch, HIVE-2020.patch
>
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'var x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "Vaibhav Aggarwal (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vaibhav Aggarwal updated HIVE-2020:
-----------------------------------

    Description: 
Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.

This ticket encompasses the following enhancements:
* Create a separate namespace for managing Hive variables.
* Add support for setting variables on the command line via '-hivevar x=y'
* Add support for setting variables through the CLI via 'set hivevar:x=y'
* Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
* Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'



  was:
Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.

This ticket encompasses the following enhancements:
* Create a separate namespace for managing Hive variables.
* Add support for setting variables on the command line via '-hivevar x=y'
* Add support for setting variables through the CLI via 'var x=y'
* Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
* Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'




> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>            Assignee: Vaibhav Aggarwal
>         Attachments: HIVE-2020-2.patch, HIVE-2020-3.patch, HIVE-2020.patch
>
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'set hivevar:x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Assigned] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "Vaibhav Aggarwal (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vaibhav Aggarwal reassigned HIVE-2020:
--------------------------------------

    Assignee: Vaibhav Aggarwal

> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>            Assignee: Vaibhav Aggarwal
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'var x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "Vaibhav Aggarwal (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13072009#comment-13072009 ] 

Vaibhav Aggarwal commented on HIVE-2020:
----------------------------------------

Requested review:

https://reviews.apache.org/r/1204/

> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'var x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2020) Create a separate namespace for Hive variables

Posted by "Vaibhav Aggarwal (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13095701#comment-13095701 ] 

Vaibhav Aggarwal commented on HIVE-2020:
----------------------------------------

Thanks for looking at this Carl!

> Create a separate namespace for Hive variables
> ----------------------------------------------
>
>                 Key: HIVE-2020
>                 URL: https://issues.apache.org/jira/browse/HIVE-2020
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Carl Steinbach
>            Assignee: Vaibhav Aggarwal
>             Fix For: 0.8.0
>
>         Attachments: HIVE-2020-2.patch, HIVE-2020-3.patch, HIVE-2020.patch
>
>
> Support for variable substitution was added in HIVE-1096. However, variable substitution was implemented by reusing the HiveConf namespace, so there is no separation between Hive configuration properties and Hive variables.
> This ticket encompasses the following enhancements:
> * Create a separate namespace for managing Hive variables.
> * Add support for setting variables on the command line via '-hivevar x=y'
> * Add support for setting variables through the CLI via 'set hivevar:x=y'
> * Add support for referencing variables in statements using either '${hivevar:var_name}' or '${var_name}'
> * Provide a means for differentiating between hiveconf, hivevar, system, and environment properties in the output of 'set -v'

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira