You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Carl Steinbach (JIRA)" <ji...@apache.org> on 2010/11/30 23:12:10 UTC

[jira] Created: (HIVE-1817) Remove Hive dependency on unrelease commons-cli 2.0 Snapshot

Remove Hive dependency on unrelease commons-cli 2.0 Snapshot
------------------------------------------------------------

                 Key: HIVE-1817
                 URL: https://issues.apache.org/jira/browse/HIVE-1817
             Project: Hive
          Issue Type: Task
          Components: Build Infrastructure, CLI
            Reporter: Carl Steinbach


The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-1817) Remove Hive dependency on unreleased commons-cli 2.0 Snapshot

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12994968#comment-12994968 ] 

Carl Steinbach commented on HIVE-1817:
--------------------------------------

@Ashutosh: I believe that bug is in 2.0, which is pretty broken in general.

> Remove Hive dependency on unreleased commons-cli 2.0 Snapshot
> -------------------------------------------------------------
>
>                 Key: HIVE-1817
>                 URL: https://issues.apache.org/jira/browse/HIVE-1817
>             Project: Hive
>          Issue Type: Task
>          Components: Build Infrastructure, CLI
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>            Priority: Blocker
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1817.2.patch.txt, HIVE-1817.3.patch.txt, HIVE-1817.wip.1.patch.txt
>
>
> The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
> Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HIVE-1817) Remove Hive dependency on unreleased commons-cli 2.0 Snapshot

Posted by "John Sichi (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

John Sichi updated HIVE-1817:
-----------------------------

      Resolution: Fixed
    Hadoop Flags: [Reviewed]
          Status: Resolved  (was: Patch Available)

Committed to branch and trunk.  Thanks Carl!


> Remove Hive dependency on unreleased commons-cli 2.0 Snapshot
> -------------------------------------------------------------
>
>                 Key: HIVE-1817
>                 URL: https://issues.apache.org/jira/browse/HIVE-1817
>             Project: Hive
>          Issue Type: Task
>          Components: Build Infrastructure, CLI
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>            Priority: Blocker
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1817.2.patch.txt, HIVE-1817.3.patch.txt, HIVE-1817.4.patch.txt, HIVE-1817.wip.1.patch.txt
>
>
> The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
> Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (HIVE-1817) Remove Hive dependency on unreleased commons-cli 2.0 Snapshot

Posted by "John Sichi (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12995379#comment-12995379 ] 

John Sichi commented on HIVE-1817:
----------------------------------

Oops, you're right, my environment was messed up.  I'll do some more testing and then commit.

> Remove Hive dependency on unreleased commons-cli 2.0 Snapshot
> -------------------------------------------------------------
>
>                 Key: HIVE-1817
>                 URL: https://issues.apache.org/jira/browse/HIVE-1817
>             Project: Hive
>          Issue Type: Task
>          Components: Build Infrastructure, CLI
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>            Priority: Blocker
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1817.2.patch.txt, HIVE-1817.3.patch.txt, HIVE-1817.4.patch.txt, HIVE-1817.wip.1.patch.txt
>
>
> The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
> Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (HIVE-1817) Remove Hive dependency on unreleased commons-cli 2.0 Snapshot

Posted by "John Sichi (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12994484#comment-12994484 ] 

John Sichi commented on HIVE-1817:
----------------------------------

+1.  Will commit if tests pass.  (I'll do some ad hoc testing on command line options as well.)


> Remove Hive dependency on unreleased commons-cli 2.0 Snapshot
> -------------------------------------------------------------
>
>                 Key: HIVE-1817
>                 URL: https://issues.apache.org/jira/browse/HIVE-1817
>             Project: Hive
>          Issue Type: Task
>          Components: Build Infrastructure, CLI
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>            Priority: Blocker
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1817.2.patch.txt, HIVE-1817.wip.1.patch.txt
>
>
> The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
> Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HIVE-1817) Remove Hive dependency on unreleased commons-cli 2.0 Snapshot

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach updated HIVE-1817:
---------------------------------

    Attachment: HIVE-1817.3.patch.txt

> Remove Hive dependency on unreleased commons-cli 2.0 Snapshot
> -------------------------------------------------------------
>
>                 Key: HIVE-1817
>                 URL: https://issues.apache.org/jira/browse/HIVE-1817
>             Project: Hive
>          Issue Type: Task
>          Components: Build Infrastructure, CLI
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>            Priority: Blocker
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1817.2.patch.txt, HIVE-1817.3.patch.txt, HIVE-1817.wip.1.patch.txt
>
>
> The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
> Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HIVE-1817) Remove Hive dependency on unrelease commons-cli 2.0 Snapshot

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach updated HIVE-1817:
---------------------------------

    Attachment: HIVE-1817.wip.1.patch.txt

The attached patch modifies OptionProcessor to use commons-cli-1.2 instead
of commons-cli-2.0-SNAPSHOT. The version of HiveCli that results works as 
long as the underlying Hadoop version does not also have a dependency on
commons-cli-2.0-SNAPSHOT (i.e. it will work on 0.20.3, but not on 0.20.0),
in which case HiveCli ends up picking up commons-cli-2.0-SNAPSHOT instead
of 1.2 since Hadoop's CLASSPATH is given preference over Hive's.

I think the solution to this problem involves modifying the bin/hive script to
call Java directly instead of delegating this responsibility to bin/hadoop.

> Remove Hive dependency on unrelease commons-cli 2.0 Snapshot
> ------------------------------------------------------------
>
>                 Key: HIVE-1817
>                 URL: https://issues.apache.org/jira/browse/HIVE-1817
>             Project: Hive
>          Issue Type: Task
>          Components: Build Infrastructure, CLI
>            Reporter: Carl Steinbach
>         Attachments: HIVE-1817.wip.1.patch.txt
>
>
> The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
> Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-1817) Remove Hive dependency on unreleased commons-cli 2.0 Snapshot

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12995158#comment-12995158 ] 

Carl Steinbach commented on HIVE-1817:
--------------------------------------

Here's the result I get after applying the patch to a fresh checkout:

{code}
% build/dist/bin/hive
Cannot find hadoop installation: $HADOOP_HOME must be set or hadoop must be in the path
% ls build/hadoopcore/
hadoop-0.20.1		 hadoop-0.20.3-CDH3-SNAPSHOT
hadoop-0.20.1.installed  hadoop-0.20.3-CDH3-SNAPSHOT.installed
hadoop-0.20.1.tar.gz	 hadoop-0.20.3-CDH3-SNAPSHOT.tar.gz
% export HADOOP_HOME=~/Work/repos/hive-rev/build/hadoopcore/hadoop-0.20.1
% build/dist/bin/hive
Hive history file=/tmp/carl/hive_job_log_carl_201102152028_838041018.txt
hive> quit;
quit;
% 
{code}

It looks like you already have bin/hadoop on your PATH or HADOOP_HOME is defined in your environment.


> Remove Hive dependency on unreleased commons-cli 2.0 Snapshot
> -------------------------------------------------------------
>
>                 Key: HIVE-1817
>                 URL: https://issues.apache.org/jira/browse/HIVE-1817
>             Project: Hive
>          Issue Type: Task
>          Components: Build Infrastructure, CLI
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>            Priority: Blocker
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1817.2.patch.txt, HIVE-1817.3.patch.txt, HIVE-1817.4.patch.txt, HIVE-1817.wip.1.patch.txt
>
>
> The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
> Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HIVE-1817) Remove Hive dependency on unrelease commons-cli 2.0 Snapshot

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach updated HIVE-1817:
---------------------------------

    Attachment: HIVE-1817.2.patch.txt

> Remove Hive dependency on unrelease commons-cli 2.0 Snapshot
> ------------------------------------------------------------
>
>                 Key: HIVE-1817
>                 URL: https://issues.apache.org/jira/browse/HIVE-1817
>             Project: Hive
>          Issue Type: Task
>          Components: Build Infrastructure, CLI
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>            Priority: Blocker
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1817.2.patch.txt, HIVE-1817.wip.1.patch.txt
>
>
> The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
> Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HIVE-1817) Remove Hive dependency on unreleased commons-cli 2.0 Snapshot

Posted by "John Sichi (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

John Sichi updated HIVE-1817:
-----------------------------

    Status: Open  (was: Patch Available)

I'm getting the build failure below.  I think it's because you added ivy-retrieve to the compile target in build-common.xml.

{noformat}
ivy-resolve:
[ivy:resolve] :: Ivy 2.1.0 - 20090925235825 :: http://ant.apache.org/ivy/ ::
[ivy:resolve] :: loading settings :: file = /data/users/jsichi/open/test-trunk/ivy/ivysettings.xml
[ivy:resolve] /data/users/jsichi/open/test-trunk/odbc/ivy.xml (No such file or directory) in file:/data/users/jsichi/open/test-trunk/odbc/ivy.xml

BUILD FAILED
/data/users/jsichi/open/test-trunk/build.xml:200: The following error occurred while executing this line:
/data/users/jsichi/open/test-trunk/build.xml:96: The following error occurred while executing this line:
/data/users/jsichi/open/test-trunk/build-common.xml:163: syntax errors in ivy file: java.text.ParseException: /data/users/jsichi/open/test-trunk/odbc/ivy.xml (No such file or directory) in file:/data/users/jsichi/open/test-trunk/odbc/ivy.xml
	at org.apache.ivy.plugins.parser.xml.XmlModuleDescriptorParser$Parser.parse(XmlModuleDescriptorParser.java:263)
{noformat}


> Remove Hive dependency on unreleased commons-cli 2.0 Snapshot
> -------------------------------------------------------------
>
>                 Key: HIVE-1817
>                 URL: https://issues.apache.org/jira/browse/HIVE-1817
>             Project: Hive
>          Issue Type: Task
>          Components: Build Infrastructure, CLI
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>            Priority: Blocker
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1817.2.patch.txt, HIVE-1817.wip.1.patch.txt
>
>
> The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
> Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HIVE-1817) Remove Hive dependency on unreleased commons-cli 2.0 Snapshot

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach updated HIVE-1817:
---------------------------------

    Status: Patch Available  (was: Open)

Review request: https://reviews.apache.org/r/421

Summary of changes:

* Modified OptionsProcessor to use commons-cli 1.2 instead of 2.0-SNAPSHOT
* Changed default hadoop.version from 0.20.0 to 0.20.1 (Note that 0.20.2 is not available on the FB CDN)
* Updated bin/hive scripts to enforce dependency on Hadoop 0.20.x (x >= 1).
* Updated ivy configuration to pull down commons-cli 1.2
* Added a bunch of missing ASF headers.

Note to committer: Please run 'svn rm lib/commons-cli-2.0-SNAPSHOT.jar before committing.


> Remove Hive dependency on unreleased commons-cli 2.0 Snapshot
> -------------------------------------------------------------
>
>                 Key: HIVE-1817
>                 URL: https://issues.apache.org/jira/browse/HIVE-1817
>             Project: Hive
>          Issue Type: Task
>          Components: Build Infrastructure, CLI
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>            Priority: Blocker
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1817.2.patch.txt, HIVE-1817.wip.1.patch.txt
>
>
> The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
> Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HIVE-1817) Remove Hive dependency on unreleased commons-cli 2.0 Snapshot

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach updated HIVE-1817:
---------------------------------

    Status: Patch Available  (was: Open)

@John: I started running into the PermGen OOM error too, and ended up removing the ivy-retrieve dependency on build-common's compile target, and instead took the path of least resistance and copied the compile target to cli/build.xml.

This revision of the patch also incorporates a one-line fix for HIVE-1981. I will defer the more ambitious build refactoring for another time.

I verified that all of the targets listed via 'ant -p' pass with this patch in place.


> Remove Hive dependency on unreleased commons-cli 2.0 Snapshot
> -------------------------------------------------------------
>
>                 Key: HIVE-1817
>                 URL: https://issues.apache.org/jira/browse/HIVE-1817
>             Project: Hive
>          Issue Type: Task
>          Components: Build Infrastructure, CLI
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>            Priority: Blocker
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1817.2.patch.txt, HIVE-1817.3.patch.txt, HIVE-1817.4.patch.txt, HIVE-1817.wip.1.patch.txt
>
>
> The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
> Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (HIVE-1817) Remove Hive dependency on unreleased commons-cli 2.0 Snapshot

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12994976#comment-12994976 ] 

Carl Steinbach commented on HIVE-1817:
--------------------------------------

Updated review request: https://reviews.apache.org/r/421/


> Remove Hive dependency on unreleased commons-cli 2.0 Snapshot
> -------------------------------------------------------------
>
>                 Key: HIVE-1817
>                 URL: https://issues.apache.org/jira/browse/HIVE-1817
>             Project: Hive
>          Issue Type: Task
>          Components: Build Infrastructure, CLI
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>            Priority: Blocker
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1817.2.patch.txt, HIVE-1817.3.patch.txt, HIVE-1817.4.patch.txt, HIVE-1817.wip.1.patch.txt
>
>
> The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
> Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (HIVE-1817) Remove Hive dependency on unreleased commons-cli 2.0 Snapshot

Posted by "John Sichi (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12995148#comment-12995148 ] 

John Sichi commented on HIVE-1817:
----------------------------------

Carl, I ran that in my fresh checkout after the build, so I should have been getting the default Hadoop version for a Hive development environment, which needs to be something that works.


> Remove Hive dependency on unreleased commons-cli 2.0 Snapshot
> -------------------------------------------------------------
>
>                 Key: HIVE-1817
>                 URL: https://issues.apache.org/jira/browse/HIVE-1817
>             Project: Hive
>          Issue Type: Task
>          Components: Build Infrastructure, CLI
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>            Priority: Blocker
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1817.2.patch.txt, HIVE-1817.3.patch.txt, HIVE-1817.4.patch.txt, HIVE-1817.wip.1.patch.txt
>
>
> The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
> Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HIVE-1817) Remove Hive dependency on unrelease commons-cli 2.0 Snapshot

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach updated HIVE-1817:
---------------------------------

         Priority: Blocker  (was: Major)
    Fix Version/s: 0.7.0

According to a comment in HADOOP-3676 ASF rules state "Don't release with unreleased versions of other bits of apache code."

Marking this as a blocker for 0.7.0


> Remove Hive dependency on unrelease commons-cli 2.0 Snapshot
> ------------------------------------------------------------
>
>                 Key: HIVE-1817
>                 URL: https://issues.apache.org/jira/browse/HIVE-1817
>             Project: Hive
>          Issue Type: Task
>          Components: Build Infrastructure, CLI
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>            Priority: Blocker
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1817.wip.1.patch.txt
>
>
> The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
> Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-1817) Remove Hive dependency on unreleased commons-cli 2.0 Snapshot

Posted by "John Sichi (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

John Sichi updated HIVE-1817:
-----------------------------

    Status: Open  (was: Patch Available)

Tests pass now, but when I try to run CLI interactively, I get the failure below.  hadoop -version is no longer returning information in the expected format.

{noformat}
[jsichi@dev1066 ~/open/test-trunk] build/dist/bin/hive
Hive requires Hadoop 0.20.x (x >= 1).
'hadoop version' returned:
Hadoop 0.20.0 Subversion https://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.20 -r 763504 Compiled by ndaley on Thu Apr 9 05:18:40 UTC 2009
{noformat}


> Remove Hive dependency on unreleased commons-cli 2.0 Snapshot
> -------------------------------------------------------------
>
>                 Key: HIVE-1817
>                 URL: https://issues.apache.org/jira/browse/HIVE-1817
>             Project: Hive
>          Issue Type: Task
>          Components: Build Infrastructure, CLI
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>            Priority: Blocker
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1817.2.patch.txt, HIVE-1817.3.patch.txt, HIVE-1817.4.patch.txt, HIVE-1817.wip.1.patch.txt
>
>
> The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
> Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (HIVE-1817) Remove Hive dependency on unreleased commons-cli 2.0 Snapshot

Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12994733#comment-12994733 ] 

Ashutosh Chauhan commented on HIVE-1817:
----------------------------------------

There is atleast one corner case which should be tested. Can't recall whether its in 2.0 or in 1.2. If value of option starts with a '-' that is not handled properly by the library.  

> Remove Hive dependency on unreleased commons-cli 2.0 Snapshot
> -------------------------------------------------------------
>
>                 Key: HIVE-1817
>                 URL: https://issues.apache.org/jira/browse/HIVE-1817
>             Project: Hive
>          Issue Type: Task
>          Components: Build Infrastructure, CLI
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>            Priority: Blocker
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1817.2.patch.txt, HIVE-1817.3.patch.txt, HIVE-1817.wip.1.patch.txt
>
>
> The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
> Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HIVE-1817) Remove Hive dependency on unreleased commons-cli 2.0 Snapshot

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach updated HIVE-1817:
---------------------------------

    Status: Patch Available  (was: Open)

Resolved the odbc/ issues by adding a dummy 'compile' target to odbc/build.xml. Also added mostly empty ivy.xml files to the jdbc and service subdirs.

> Remove Hive dependency on unreleased commons-cli 2.0 Snapshot
> -------------------------------------------------------------
>
>                 Key: HIVE-1817
>                 URL: https://issues.apache.org/jira/browse/HIVE-1817
>             Project: Hive
>          Issue Type: Task
>          Components: Build Infrastructure, CLI
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>            Priority: Blocker
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1817.2.patch.txt, HIVE-1817.3.patch.txt, HIVE-1817.wip.1.patch.txt
>
>
> The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
> Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Assigned: (HIVE-1817) Remove Hive dependency on unrelease commons-cli 2.0 Snapshot

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach reassigned HIVE-1817:
------------------------------------

    Assignee: Carl Steinbach

> Remove Hive dependency on unrelease commons-cli 2.0 Snapshot
> ------------------------------------------------------------
>
>                 Key: HIVE-1817
>                 URL: https://issues.apache.org/jira/browse/HIVE-1817
>             Project: Hive
>          Issue Type: Task
>          Components: Build Infrastructure, CLI
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>         Attachments: HIVE-1817.wip.1.patch.txt
>
>
> The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
> Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-1817) Remove Hive dependency on unreleased commons-cli 2.0 Snapshot

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach updated HIVE-1817:
---------------------------------

    Status: Patch Available  (was: Open)

@John: That's the correct behavior. You're trying to run against 0.20.0, and this patch makes it a requirement to run against 0.20.1 or later.

> Remove Hive dependency on unreleased commons-cli 2.0 Snapshot
> -------------------------------------------------------------
>
>                 Key: HIVE-1817
>                 URL: https://issues.apache.org/jira/browse/HIVE-1817
>             Project: Hive
>          Issue Type: Task
>          Components: Build Infrastructure, CLI
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>            Priority: Blocker
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1817.2.patch.txt, HIVE-1817.3.patch.txt, HIVE-1817.4.patch.txt, HIVE-1817.wip.1.patch.txt
>
>
> The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
> Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HIVE-1817) Remove Hive dependency on unreleased commons-cli 2.0 Snapshot

Posted by "John Sichi (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

John Sichi updated HIVE-1817:
-----------------------------

    Status: Open  (was: Patch Available)

Now I'm getting a new build failure in a clean checkout plus the latest patch:

{noformat}
compile-test:

BUILD FAILED
/data/users/jsichi/open/test-trunk/build.xml:200: The following error occurred while executing this line:
/data/users/jsichi/open/test-trunk/build.xml:96: The following error occurred while executing this line:
/data/users/jsichi/open/test-trunk/build-common.xml:317: destination directory "/data/users/jsichi/open/test-trunk/build/odbc/test/classes" does not exist or is not a directory
{noformat}


> Remove Hive dependency on unreleased commons-cli 2.0 Snapshot
> -------------------------------------------------------------
>
>                 Key: HIVE-1817
>                 URL: https://issues.apache.org/jira/browse/HIVE-1817
>             Project: Hive
>          Issue Type: Task
>          Components: Build Infrastructure, CLI
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>            Priority: Blocker
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1817.2.patch.txt, HIVE-1817.3.patch.txt, HIVE-1817.wip.1.patch.txt
>
>
> The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
> Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Updated: (HIVE-1817) Remove Hive dependency on unreleased commons-cli 2.0 Snapshot

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach updated HIVE-1817:
---------------------------------

    Summary: Remove Hive dependency on unreleased commons-cli 2.0 Snapshot  (was: Remove Hive dependency on unrelease commons-cli 2.0 Snapshot)

> Remove Hive dependency on unreleased commons-cli 2.0 Snapshot
> -------------------------------------------------------------
>
>                 Key: HIVE-1817
>                 URL: https://issues.apache.org/jira/browse/HIVE-1817
>             Project: Hive
>          Issue Type: Task
>          Components: Build Infrastructure, CLI
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>            Priority: Blocker
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1817.2.patch.txt, HIVE-1817.wip.1.patch.txt
>
>
> The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
> Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (HIVE-1817) Remove Hive dependency on unrelease commons-cli 2.0 Snapshot

Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12984400#action_12984400 ] 

Edward Capriolo commented on HIVE-1817:
---------------------------------------

Arge. This is a major buzzkill, our shims, build, eclipse generation processes can not deal easily with lib changes for minor versions. 


Option 1. This angers me. Pushed into an update by a CLI jar, but it seems like the right think to do.

Option 2.  More bash scripting is only going to make the problem worse

As an option 3 we do have a ticket for a hive JobShell. Which would be some perfect new shell that is not so married to bash and hadoop, I imagine this new job shell would do explicit class loading and would reference nothing except HIVE_HOME from the environment.

Option 4. We use some other CLI library. 

+1 option 1. Push forward at all costs including forcing someone with 0.20.0 to upgrade just for hive.

> Remove Hive dependency on unrelease commons-cli 2.0 Snapshot
> ------------------------------------------------------------
>
>                 Key: HIVE-1817
>                 URL: https://issues.apache.org/jira/browse/HIVE-1817
>             Project: Hive
>          Issue Type: Task
>          Components: Build Infrastructure, CLI
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>            Priority: Blocker
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1817.wip.1.patch.txt
>
>
> The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
> Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-1817) Remove Hive dependency on unreleased commons-cli 2.0 Snapshot

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach updated HIVE-1817:
---------------------------------

    Attachment: HIVE-1817.4.patch.txt

> Remove Hive dependency on unreleased commons-cli 2.0 Snapshot
> -------------------------------------------------------------
>
>                 Key: HIVE-1817
>                 URL: https://issues.apache.org/jira/browse/HIVE-1817
>             Project: Hive
>          Issue Type: Task
>          Components: Build Infrastructure, CLI
>            Reporter: Carl Steinbach
>            Assignee: Carl Steinbach
>            Priority: Blocker
>             Fix For: 0.7.0
>
>         Attachments: HIVE-1817.2.patch.txt, HIVE-1817.3.patch.txt, HIVE-1817.4.patch.txt, HIVE-1817.wip.1.patch.txt
>
>
> The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the commons-cli project is dead.
> Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more information.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira