You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Joydeep Sen Sarma (JIRA)" <ji...@apache.org> on 2011/03/10 00:32:59 UTC
[jira] Created: (HIVE-2039) remove hadoop version check from hive
cli shell script
remove hadoop version check from hive cli shell script
------------------------------------------------------
Key: HIVE-2039
URL: https://issues.apache.org/jira/browse/HIVE-2039
Project: Hive
Issue Type: Improvement
Components: CLI
Reporter: Joydeep Sen Sarma
looking at cli startup times - one thing i noticed is that the version check in execHiveCmd.sh consumes 0.5-1s of wall-clock time (depending on where hive is installed).
AFAIK - hive doesn't support versions less than 20 right now - and this check is only to check if version is less than 20. So we should be able to safely take it out. please comment if that is not the case.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HIVE-2039) remove hadoop version check from hive
cli shell script
Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13004899#comment-13004899 ]
Ning Zhang commented on HIVE-2039:
----------------------------------
+1. Will commit if tests pass.
> remove hadoop version check from hive cli shell script
> ------------------------------------------------------
>
> Key: HIVE-2039
> URL: https://issues.apache.org/jira/browse/HIVE-2039
> Project: Hive
> Issue Type: Improvement
> Components: CLI
> Reporter: Joydeep Sen Sarma
> Assignee: Joydeep Sen Sarma
> Fix For: 0.8.0
>
> Attachments: HIVE-2039.1.patch
>
>
> looking at cli startup times - one thing i noticed is that the version check in execHiveCmd.sh consumes 0.5-1s of wall-clock time (depending on where hive is installed).
> AFAIK - hive doesn't support versions less than 20 right now - and this check is only to check if version is less than 20. So we should be able to safely take it out. please comment if that is not the case.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Reopened: (HIVE-2039) remove hadoop version check from hive
cli shell script
Posted by "Joydeep Sen Sarma (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joydeep Sen Sarma reopened HIVE-2039:
-------------------------------------
Assignee: Joydeep Sen Sarma
spoke too fast - the version check has moved to a different place - but it's still there. i plan to provide a way to avoid the version check (via env var) because it's pretty expensive. it would still be there by default.
> remove hadoop version check from hive cli shell script
> ------------------------------------------------------
>
> Key: HIVE-2039
> URL: https://issues.apache.org/jira/browse/HIVE-2039
> Project: Hive
> Issue Type: Improvement
> Components: CLI
> Reporter: Joydeep Sen Sarma
> Assignee: Joydeep Sen Sarma
>
> looking at cli startup times - one thing i noticed is that the version check in execHiveCmd.sh consumes 0.5-1s of wall-clock time (depending on where hive is installed).
> AFAIK - hive doesn't support versions less than 20 right now - and this check is only to check if version is less than 20. So we should be able to safely take it out. please comment if that is not the case.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HIVE-2039) remove hadoop version check from hive
cli shell script
Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ning Zhang updated HIVE-2039:
-----------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
Committed. Thanks Joydeep!
> remove hadoop version check from hive cli shell script
> ------------------------------------------------------
>
> Key: HIVE-2039
> URL: https://issues.apache.org/jira/browse/HIVE-2039
> Project: Hive
> Issue Type: Improvement
> Components: CLI
> Reporter: Joydeep Sen Sarma
> Assignee: Joydeep Sen Sarma
> Fix For: 0.8.0
>
> Attachments: HIVE-2039.1.patch
>
>
> looking at cli startup times - one thing i noticed is that the version check in execHiveCmd.sh consumes 0.5-1s of wall-clock time (depending on where hive is installed).
> AFAIK - hive doesn't support versions less than 20 right now - and this check is only to check if version is less than 20. So we should be able to safely take it out. please comment if that is not the case.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HIVE-2039) remove hadoop version check from hive
cli shell script
Posted by "Joydeep Sen Sarma (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joydeep Sen Sarma updated HIVE-2039:
------------------------------------
Fix Version/s: 0.8.0
Release Note: hive startup shell script allows bypassing running 'hadoop version' subcommand via setting of HADOOP_VERSION environment variable. this can reduce latency of starting up the hive cli.
Status: Patch Available (was: Reopened)
> remove hadoop version check from hive cli shell script
> ------------------------------------------------------
>
> Key: HIVE-2039
> URL: https://issues.apache.org/jira/browse/HIVE-2039
> Project: Hive
> Issue Type: Improvement
> Components: CLI
> Reporter: Joydeep Sen Sarma
> Assignee: Joydeep Sen Sarma
> Fix For: 0.8.0
>
> Attachments: HIVE-2039.1.patch
>
>
> looking at cli startup times - one thing i noticed is that the version check in execHiveCmd.sh consumes 0.5-1s of wall-clock time (depending on where hive is installed).
> AFAIK - hive doesn't support versions less than 20 right now - and this check is only to check if version is less than 20. So we should be able to safely take it out. please comment if that is not the case.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Resolved: (HIVE-2039) remove hadoop version check from hive
cli shell script
Posted by "Joydeep Sen Sarma (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joydeep Sen Sarma resolved HIVE-2039.
-------------------------------------
Resolution: Invalid
never mind. looks like it's already gone and i am looking at old version.
> remove hadoop version check from hive cli shell script
> ------------------------------------------------------
>
> Key: HIVE-2039
> URL: https://issues.apache.org/jira/browse/HIVE-2039
> Project: Hive
> Issue Type: Improvement
> Components: CLI
> Reporter: Joydeep Sen Sarma
>
> looking at cli startup times - one thing i noticed is that the version check in execHiveCmd.sh consumes 0.5-1s of wall-clock time (depending on where hive is installed).
> AFAIK - hive doesn't support versions less than 20 right now - and this check is only to check if version is less than 20. So we should be able to safely take it out. please comment if that is not the case.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HIVE-2039) remove hadoop version check from hive
cli shell script
Posted by "Joydeep Sen Sarma (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joydeep Sen Sarma updated HIVE-2039:
------------------------------------
Attachment: HIVE-2039.1.patch
skip hadoop version check via hadoop subcommand if version is supplied by env variable.
> remove hadoop version check from hive cli shell script
> ------------------------------------------------------
>
> Key: HIVE-2039
> URL: https://issues.apache.org/jira/browse/HIVE-2039
> Project: Hive
> Issue Type: Improvement
> Components: CLI
> Reporter: Joydeep Sen Sarma
> Assignee: Joydeep Sen Sarma
> Attachments: HIVE-2039.1.patch
>
>
> looking at cli startup times - one thing i noticed is that the version check in execHiveCmd.sh consumes 0.5-1s of wall-clock time (depending on where hive is installed).
> AFAIK - hive doesn't support versions less than 20 right now - and this check is only to check if version is less than 20. So we should be able to safely take it out. please comment if that is not the case.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira