You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "John George (Created) (JIRA)" <ji...@apache.org> on 2011/11/09 16:53:52 UTC
[jira] [Created] (HADOOP-7810) add hadoop-tools.jar to 'hadoop
classpath'
add hadoop-tools.jar to 'hadoop classpath'
------------------------------------------
Key: HADOOP-7810
URL: https://issues.apache.org/jira/browse/HADOOP-7810
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 0.20.205.0, 0.24.0, 0.23.1
Reporter: John George
Assignee: John George
"The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7810) add hadoop-tools.jar to 'hadoop
classpath'
Posted by "John George (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John George updated HADOOP-7810:
--------------------------------
Attachment: hadoop-7810.branch-0.20-security.patch
> add hadoop-tools.jar to 'hadoop classpath'
> ------------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1
> Reporter: John George
> Assignee: John George
> Fix For: 0.20.205.1
>
> Attachments: hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7810) add hadoop-tools.jar to 'hadoop
classpath'
Posted by "John George (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John George updated HADOOP-7810:
--------------------------------
Fix Version/s: 0.20.205.1
Status: Patch Available (was: Open)
> add hadoop-tools.jar to 'hadoop classpath'
> ------------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1
> Reporter: John George
> Assignee: John George
> Fix For: 0.20.205.1
>
> Attachments: hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Owen O'Malley (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13156398#comment-13156398 ]
Owen O'Malley commented on HADOOP-7810:
---------------------------------------
Let's not assume that it will move to a new jar, since that isn't very backwards compatible. I've committed the change to 205 + security. If you can make a patch for trunk (actually defining the TOOL_PATH), that would be great.
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1, 0.24.0, 0.23.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Fix For: 0.20.205.1
>
> Attachments: hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Thomas Weise (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152377#comment-13152377 ]
Thomas Weise commented on HADOOP-7810:
--------------------------------------
Every downstream project would need to modify its class path to make this happen (Pig, HCatalog etc.). This would be necessary for any other dependency, but here we deal with a component that is already deployed with Hadoop and we would like to be able to configure it as part of Hadoop. We would prefer a solution that involves a single stop?
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168715#comment-13168715 ]
Hudson commented on HADOOP-7810:
--------------------------------
Integrated in Hadoop-Mapreduce-0.23-Commit #291 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/291/])
Merge -r 1213907:1213908 and 1213910:1213911 from trunk to branch. FIXES: HADOOP-7810
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213915
Files :
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestHarFileSystem.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/fs/TestHarFileSystem.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/tools/TestHadoopArchives.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/HadoopArchives.java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org/apache
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop/tools
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop/tools/HadoopArchives.java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org/apache
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop/tools
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop/tools/TestHadoopArchives.java
* /hadoop/common/branches/branch-0.23/hadoop-tools/pom.xml
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Fix For: 0.24.0, 0.23.1
>
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13169453#comment-13169453 ]
Hudson commented on HADOOP-7810:
--------------------------------
Integrated in Hadoop-Mapreduce-trunk #927 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/927/])
HADOOP-7810. move hadoop archive to core from tools [missing file from original commit]. (tucu)
HADOOP-7810. move hadoop archive to core from tools. (tucu)
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213911
Files :
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/pom.xml
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213907
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestHarFileSystem.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/fs/TestHarFileSystem.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/tools/TestHadoopArchives.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/HadoopArchives.java
* /hadoop/common/trunk/hadoop-tools/hadoop-archives
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org/apache
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop/tools
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop/tools/HadoopArchives.java
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org/apache
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop/tools
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop/tools/TestHadoopArchives.java
* /hadoop/common/trunk/hadoop-tools/pom.xml
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Fix For: 0.24.0, 0.23.1
>
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7810) add hadoop-tools.jar to 'hadoop
classpath'
Posted by "John George (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John George updated HADOOP-7810:
--------------------------------
Priority: Blocker (was: Major)
Affects Version/s: 0.20.205.1
Fix Version/s: (was: 0.20.205.1)
Marking as a blocker for 0.20.205.1
> add hadoop-tools.jar to 'hadoop classpath'
> ------------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Owen O'Malley (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155418#comment-13155418 ]
Owen O'Malley commented on HADOOP-7810:
---------------------------------------
+1
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1, 0.24.0, 0.23.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7810) add hadoop-tools.jar to 'hadoop
classpath'
Posted by "Matt Foley (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matt Foley updated HADOOP-7810:
-------------------------------
Target Version/s: 0.20.205.1
When targeting a patch for a given release, please list that release in the "Target Version" field. Thank you.
> add hadoop-tools.jar to 'hadoop classpath'
> ------------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) add hadoop-tools.jar to 'hadoop
classpath'
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147136#comment-13147136 ]
Hadoop QA commented on HADOOP-7810:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12503096/hadoop-7810.branch-0.20-security.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/370//console
This message is automatically generated.
> add hadoop-tools.jar to 'hadoop classpath'
> ------------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1
> Reporter: John George
> Assignee: John George
> Fix For: 0.20.205.1
>
> Attachments: hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Egil Sorensen (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150163#comment-13150163 ]
Egil Sorensen commented on HADOOP-7810:
---------------------------------------
@Owen - The use case is for a storing from a Pig script using HCatalog's dynamic partitioning and with HAR enabled.
Correct, the HarFileSystem is in the classpath.
But a call like the above fails with a ClassNotFoundException on org.apache.hadoop.tools.HadoopArchives$HArchiveInputFormat.
Therefore the suggestion to move the HadoopArchieves classes from hadoop_tools jar, which is not in `hadoop classpath`, into the hadoop-core jar. (The same jar that holds the HarFileSystem class.)
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "John George (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13156410#comment-13156410 ]
John George commented on HADOOP-7810:
-------------------------------------
I am a little confused - AFAIK as of now har is in a new jar (hadoop-mapreduce-tools) compared to 205 (hadoop-tools/hadoop-core). Are you saying that we should assume it will continue in hadoop-mapreduce-tools?
There are two JIRAs where discussions are ongoing about mavenization and location (MAPREDUCE-2765 and MAPREDUCE-3467).
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1, 0.24.0, 0.23.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Fix For: 0.20.205.1
>
> Attachments: hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168697#comment-13168697 ]
Hudson commented on HADOOP-7810:
--------------------------------
Integrated in Hadoop-Hdfs-0.23-Commit #269 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/269/])
Merge -r 1213907:1213908 and 1213910:1213911 from trunk to branch. FIXES: HADOOP-7810
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213915
Files :
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestHarFileSystem.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/fs/TestHarFileSystem.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/tools/TestHadoopArchives.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/HadoopArchives.java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org/apache
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop/tools
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop/tools/HadoopArchives.java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org/apache
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop/tools
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop/tools/TestHadoopArchives.java
* /hadoop/common/branches/branch-0.23/hadoop-tools/pom.xml
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Fix For: 0.24.0, 0.23.1
>
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168703#comment-13168703 ]
Hudson commented on HADOOP-7810:
--------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #1438 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1438/])
HADOOP-7810. move hadoop archive to core from tools. (tucu)
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213907
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestHarFileSystem.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/fs/TestHarFileSystem.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/tools/TestHadoopArchives.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/HadoopArchives.java
* /hadoop/common/trunk/hadoop-tools/hadoop-archives
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org/apache
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop/tools
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop/tools/HadoopArchives.java
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org/apache
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop/tools
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop/tools/TestHadoopArchives.java
* /hadoop/common/trunk/hadoop-tools/pom.xml
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Fix For: 0.24.0, 0.23.1
>
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "John George (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13164659#comment-13164659 ]
John George commented on HADOOP-7810:
-------------------------------------
We found that we have different users use their own versions of distcp and with this change, we break their usecase. Those users are expecting the behavior to not change in sustaining releases. While this behavior from our users will go away soon, making this change in a sustaining release seems to be too risky. Could we revert this change and move this to the 0.23/trunk? I was the one who was trying to push this change, but I did not forsee something like this happening and hence the request.
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Fix For: 1.0.0
>
> Attachments: hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) add hadoop-tools.jar to 'hadoop
classpath'
Posted by "John George (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147183#comment-13147183 ]
John George commented on HADOOP-7810:
-------------------------------------
Alejandro, Owen - thanks for taking a look.
@Owen - Could you help me understand how it will be more difficult than it is today? Also, do you have an alternative recommendation?
> add hadoop-tools.jar to 'hadoop classpath'
> ------------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0
> Reporter: John George
> Assignee: John George
> Fix For: 0.20.205.1
>
> Attachments: hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Matt Foley (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matt Foley updated HADOOP-7810:
-------------------------------
Target Version/s: 0.23.1, 1.0.0 (was: 1.0.0, 0.23.1)
Fix Version/s: (was: 1.0.0)
Reverted from 1.0.0 and branch-1, per contributor's request.
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) add hadoop-tools.jar to 'hadoop
classpath'
Posted by "Owen O'Malley (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147925#comment-13147925 ]
Owen O'Malley commented on HADOOP-7810:
---------------------------------------
The tools jar was pulled out of hadoop's jar, because they are user-facing components that often need to be updated by users. Until we have a better story for how to get modules onto the bin/hadoop classpath, I'd propose that instead of this that you move the HarFileSystem (and only the HarFileSystem) into the hadoop-core jar.
> add hadoop-tools.jar to 'hadoop classpath'
> ------------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "John George (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John George updated HADOOP-7810:
--------------------------------
Summary: move hadoop archive to core from tools (was: add hadoop-tools.jar to 'hadoop classpath')
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "John George (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13148066#comment-13148066 ]
John George commented on HADOOP-7810:
-------------------------------------
Thanks for your response Owen. Attaching a patch for preliminary review ...
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168692#comment-13168692 ]
Hudson commented on HADOOP-7810:
--------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #1488 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1488/])
HADOOP-7810. move hadoop archive to core from tools [missing file from original commit]. (tucu)
HADOOP-7810. move hadoop archive to core from tools. (tucu)
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213911
Files :
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/pom.xml
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213907
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestHarFileSystem.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/fs/TestHarFileSystem.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/tools/TestHadoopArchives.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/HadoopArchives.java
* /hadoop/common/trunk/hadoop-tools/hadoop-archives
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org/apache
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop/tools
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop/tools/HadoopArchives.java
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org/apache
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop/tools
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop/tools/TestHadoopArchives.java
* /hadoop/common/trunk/hadoop-tools/pom.xml
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Fix For: 0.24.0, 0.23.1
>
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7810) add hadoop-tools.jar to 'hadoop
classpath'
Posted by "John George (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John George updated HADOOP-7810:
--------------------------------
Affects Version/s: (was: 0.23.1)
(was: 0.24.0)
> add hadoop-tools.jar to 'hadoop classpath'
> ------------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0
> Reporter: John George
> Assignee: John George
> Fix For: 0.20.205.1
>
> Attachments: hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Matt Foley (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matt Foley updated HADOOP-7810:
-------------------------------
Fix Version/s: (was: 0.24.0)
Since it is fixed in 23.1, there is no need to state 24.0 in the "Fixed Version" field, and it confuses the release process. Removing 24.0 from the "Fixed Version" field.
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Fix For: 0.23.1
>
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Owen O'Malley (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-7810:
----------------------------------
Status: Open (was: Patch Available)
We need a patch for trunk. If I'm reading the code right, TOOL_PATH isn't defined in trunk. *sigh*
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1, 0.24.0, 0.23.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Alejandro Abdelnur (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168687#comment-13168687 ]
Alejandro Abdelnur commented on HADOOP-7810:
--------------------------------------------
committed to trunk and branch-0.23
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Fix For: 0.24.0, 0.23.1
>
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Owen O'Malley (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149946#comment-13149946 ]
Owen O'Malley commented on HADOOP-7810:
---------------------------------------
I'm sorry, I'm confused. I thought the point of this jira was to fix the HarFileSystem into the classpath, but I see that it already there. I don't think we should move the tool to the mapreduce jar. What is the use case that requires the har tool to be on the classpath?
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Alejandro Abdelnur (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alejandro Abdelnur resolved HADOOP-7810.
----------------------------------------
Resolution: Fixed
Fix Version/s: 0.23.1
0.24.0
Target Version/s: 0.23.1, 1.0.0 (was: 1.0.0, 0.23.1)
Hadoop Flags: Reviewed
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Fix For: 0.24.0, 0.23.1
>
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Alejandro Abdelnur (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13167633#comment-13167633 ]
Alejandro Abdelnur commented on HADOOP-7810:
--------------------------------------------
:), so we are good with the patch for trunk/0.23, right?
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "John George (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John George updated HADOOP-7810:
--------------------------------
Affects Version/s: 0.23.1
0.24.0
Adding trunk and 0.23 in the 'Affects version' since we need to make sure the behavior is similar in these as well.
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1, 0.24.0, 0.23.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168695#comment-13168695 ]
Hudson commented on HADOOP-7810:
--------------------------------
Integrated in Hadoop-Common-0.23-Commit #279 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/279/])
Merge -r 1213907:1213908 and 1213910:1213911 from trunk to branch. FIXES: HADOOP-7810
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213915
Files :
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestHarFileSystem.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/fs/TestHarFileSystem.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/tools/TestHadoopArchives.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/HadoopArchives.java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org/apache
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop/tools
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop/tools/HadoopArchives.java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org/apache
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop/tools
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop/tools/TestHadoopArchives.java
* /hadoop/common/branches/branch-0.23/hadoop-tools/pom.xml
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Fix For: 0.24.0, 0.23.1
>
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168694#comment-13168694 ]
Hudson commented on HADOOP-7810:
--------------------------------
Integrated in Hadoop-Common-trunk-Commit #1414 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1414/])
HADOOP-7810. move hadoop archive to core from tools [missing file from original commit]. (tucu)
HADOOP-7810. move hadoop archive to core from tools. (tucu)
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213911
Files :
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/pom.xml
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213907
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestHarFileSystem.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/fs/TestHarFileSystem.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/tools/TestHadoopArchives.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/HadoopArchives.java
* /hadoop/common/trunk/hadoop-tools/hadoop-archives
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org/apache
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop/tools
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop/tools/HadoopArchives.java
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org/apache
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop/tools
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop/tools/TestHadoopArchives.java
* /hadoop/common/trunk/hadoop-tools/pom.xml
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Fix For: 0.24.0, 0.23.1
>
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "John George (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John George updated HADOOP-7810:
--------------------------------
Status: Patch Available (was: Open)
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1, 0.24.0, 0.23.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Owen O'Malley (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150259#comment-13150259 ]
Owen O'Malley commented on HADOOP-7810:
---------------------------------------
In that case, why doesn't HCatalog put hadoop-tools.jar on its classpath? Why should hadoop-tools be any different than any of its other dependencies?
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Thomas Weise (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152482#comment-13152482 ]
Thomas Weise commented on HADOOP-7810:
--------------------------------------
Looking ahead .23 already has HadoopArchives in the path. So why can we not have the same setup for .20?
### Hadoop 0.20.205.0.1.1110280215
Subversion git://hadoopre4.corp.sk1.yahoo.com/ on branch (no branch) -r 720349ac12dd3a3a99f53bfec8f750d7807db5f1
Compiled by hadoopqa on Fri Oct 28 02:49:39 PDT 2011
[thw@gwbl2002 ~]$ hadoop org.apache.hadoop.tools.HadoopArchives
Warning: $HADOOP_HOME is deprecated.
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/tools/HadoopArchives
### Hadoop 0.23.0.1111080202
Subversion http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23.0/hadoop-common-project/hadoop-common -r 1196973
Compiled by hadoopqa on Tue Nov 8 02:12:04 PST 2011
>From source with checksum 4e42b2d96c899a98a8ab8c7cc23f27ae
bash-3.1$ hadoop org.apache.hadoop.tools.HadoopArchives
11/11/18 00:01:37 WARN conf.Configuration: mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
archive -archiveName NAME -p <parent path> <src>* <dest>
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "John George (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13156388#comment-13156388 ]
John George commented on HADOOP-7810:
-------------------------------------
I did not see it defined either, but since mavenization is going on, some of the jar files might move around. As of now, har/distcp are part of hadoop-mapreduce-tools jar. I believe it will move out of there to hadoop-tools (MAPREDUCE-2765). So, I think it might be better to wait till those changes are in before putting out a trunk patch - what do you say?
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1, 0.24.0, 0.23.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Fix For: 0.20.205.1
>
> Attachments: hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13169325#comment-13169325 ]
Hudson commented on HADOOP-7810:
--------------------------------
Integrated in Hadoop-Mapreduce-0.23-Build #125 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/125/])
Merge -r 1213907:1213908 and 1213910:1213911 from trunk to branch. FIXES: HADOOP-7810
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213915
Files :
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestHarFileSystem.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/fs/TestHarFileSystem.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/tools/TestHadoopArchives.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/HadoopArchives.java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org/apache
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop/tools
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop/tools/HadoopArchives.java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org/apache
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop/tools
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop/tools/TestHadoopArchives.java
* /hadoop/common/branches/branch-0.23/hadoop-tools/pom.xml
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Fix For: 0.24.0, 0.23.1
>
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "John George (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13167606#comment-13167606 ]
John George commented on HADOOP-7810:
-------------------------------------
Hi Alejandro,
I just finished looking into the patch. This patch seems to do two things.
1. Move hadoop archives into hadoop-tools and harfilesystem into common. This seems fine to me.
2. Add TOOL_PATH to the classpath by default. I have two comments in this case.
* TOOL_PATH is not defined yet. What will this be defined to?
* Adding TOOL_PATH to the classpath by default did break 0.20 as mentioned, but that was because of a separate distcp being used by the user. While I dont anticipate that to be the case in 0.23, I just dint know if that was going to be an issue for anyone else?
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Alejandro Abdelnur (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168542#comment-13168542 ]
Alejandro Abdelnur commented on HADOOP-7810:
--------------------------------------------
John, the change you indicate is what has to be done for integrating it to 0.23.1, the patch works cleanly in trunk.
I'll commit both shortly
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "John George (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13167541#comment-13167541 ]
John George commented on HADOOP-7810:
-------------------------------------
Thanks Alejandro. I will try this out today and let you know.
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "John George (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John George updated HADOOP-7810:
--------------------------------
Status: Open (was: Patch Available)
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Matt Foley (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matt Foley updated HADOOP-7810:
-------------------------------
Target Version/s: 0.23.1 (was: 1.0.0, 0.23.1)
It appears this is no longer being considered for inclusion in branch-1, so removing 1.x.x from the "Target Versions" field.
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Fix For: 0.23.1
>
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Alejandro Abdelnur (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alejandro Abdelnur updated HADOOP-7810:
---------------------------------------
Attachment: HADOOP-7810v1-trunk.patch
HADOOP-7810v1-trunk.sh
[PATCH for trunk and branch-0.23]
Attached there is script and patch that moves HARFileSystem to hadoop-common and HadoopArchives to tools.
A small tweak in HadoopArchives and its testclass was required to run with the new MiniMR.
Regarding on how this new JAR ends up in the distro, there is another JIRA for that, HADOOP-7907 .
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Owen O'Malley (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-7810:
----------------------------------
Fix Version/s: 0.20.205.1
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1, 0.24.0, 0.23.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Fix For: 0.20.205.1
>
> Attachments: hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "John George (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John George updated HADOOP-7810:
--------------------------------
Attachment: hadoop-7810.branch-0.20-security.patch
Thanks for your recommendation Owen.
Making the change as per Owen's suggestion - that is adding TOOLS_JAR to the end of CLASSPATH so that the current behavior is preserved and the TOOLS_JAR is in the classpath as well.
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1, 0.24.0, 0.23.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "John George (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13167636#comment-13167636 ]
John George commented on HADOOP-7810:
-------------------------------------
Please give me till EOD today to test this out. I will get back to you after.
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) add hadoop-tools.jar to 'hadoop
classpath'
Posted by "Alejandro Abdelnur (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147182#comment-13147182 ]
Alejandro Abdelnur commented on HADOOP-7810:
--------------------------------------------
Owen you have a point. However, this is a bit difficult for any of the tools bundled with Hadoop itself. One option would be to have a separate hadoop-tools project.
> add hadoop-tools.jar to 'hadoop classpath'
> ------------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0
> Reporter: John George
> Assignee: John George
> Fix For: 0.20.205.1
>
> Attachments: hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13169473#comment-13169473 ]
Hudson commented on HADOOP-7810:
--------------------------------
Integrated in Hadoop-Hdfs-trunk #894 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/894/])
HADOOP-7810. move hadoop archive to core from tools [missing file from original commit]. (tucu)
HADOOP-7810. move hadoop archive to core from tools. (tucu)
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213911
Files :
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/pom.xml
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213907
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestHarFileSystem.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/fs/TestHarFileSystem.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/tools/TestHadoopArchives.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/HadoopArchives.java
* /hadoop/common/trunk/hadoop-tools/hadoop-archives
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org/apache
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop/tools
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop/tools/HadoopArchives.java
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org/apache
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop/tools
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop/tools/TestHadoopArchives.java
* /hadoop/common/trunk/hadoop-tools/pom.xml
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Fix For: 0.24.0, 0.23.1
>
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) add hadoop-tools.jar to 'hadoop
classpath'
Posted by "Owen O'Malley (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147174#comment-13147174 ]
Owen O'Malley commented on HADOOP-7810:
---------------------------------------
This has implications for modularity, in particular, it will make it more difficult to use a different version of any of the tools.
> add hadoop-tools.jar to 'hadoop classpath'
> ------------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0
> Reporter: John George
> Assignee: John George
> Fix For: 0.20.205.1
>
> Attachments: hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Tom White (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13166711#comment-13166711 ]
Tom White commented on HADOOP-7810:
-----------------------------------
+1 for the trunk patch.
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "John George (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149734#comment-13149734 ]
John George commented on HADOOP-7810:
-------------------------------------
@Todd - Bringing the discussion about this JIRA from 'common-dev' to here.
Quoting Todd: "This seems like an incompatible change - probably a bad idea for a dot
release of a dot release of a maintenance series...."
Todd - Most of the HAR features never really worked in branch-0.20 before 0.20.205. Since 205 is probably the first branch-0.20 release with full fledged HAR, do you still consider it an incompatible change?
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "John George (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John George updated HADOOP-7810:
--------------------------------
Attachment: hadoop-7810.branch-0.20-security.patch
I am attaching a patch which moves HadoopArchives.java as part of core. I ran some basic tests, but I need to run more tests before I can 'Submit Patch'. Also, the patch format is not "apply-able". But, I am hoping that you could take a look and confirm that this is the direction you meant in your previous comment.
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "John George (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13164951#comment-13164951 ]
John George commented on HADOOP-7810:
-------------------------------------
Thank you Matt.
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Matt Foley (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matt Foley updated HADOOP-7810:
-------------------------------
Target Version/s: 0.23.1, 1.0.0 (was: 1.0.0)
bq. @John George: Adding trunk and 0.23 in the 'Affects version' since we need to make sure the behavior is similar in these as well.
I think this was intended to be added to the "Target Versions" list.
Only adding 0.23.1 since also adding it to trunk is implicit.
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Fix For: 1.0.0
>
> Attachments: hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168741#comment-13168741 ]
Hudson commented on HADOOP-7810:
--------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #1439 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1439/])
HADOOP-7810. move hadoop archive to core from tools [missing file from original commit]. (tucu)
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213911
Files :
* /hadoop/common/trunk/hadoop-tools/hadoop-archives/pom.xml
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Fix For: 0.24.0, 0.23.1
>
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155237#comment-13155237 ]
Hadoop QA commented on HADOOP-7810:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12504253/hadoop-7810.branch-0.20-security.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/395//console
This message is automatically generated.
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1, 0.24.0, 0.23.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13169302#comment-13169302 ]
Hudson commented on HADOOP-7810:
--------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #107 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/107/])
Merge -r 1213907:1213908 and 1213910:1213911 from trunk to branch. FIXES: HADOOP-7810
tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1213915
Files :
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestHarFileSystem.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/fs/TestHarFileSystem.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/tools/TestHadoopArchives.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/fs/HarFileSystem.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/tools/org/apache/hadoop/tools/HadoopArchives.java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org/apache
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop/tools
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/main/java/org/apache/hadoop/tools/HadoopArchives.java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org/apache
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop/tools
* /hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-archives/src/test/java/org/apache/hadoop/tools/TestHadoopArchives.java
* /hadoop/common/branches/branch-0.23/hadoop-tools/pom.xml
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Fix For: 0.24.0, 0.23.1
>
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Alejandro Abdelnur (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13167619#comment-13167619 ]
Alejandro Abdelnur commented on HADOOP-7810:
--------------------------------------------
John,
Thanks for looking at it. I'm a bit confused, the trunk patch does only #1. For #2 HADOOP_7907 will take care of packaging the tools jars and making them avail to the hadoop scripts.
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Owen O'Malley (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152960#comment-13152960 ]
Owen O'Malley commented on HADOOP-7810:
---------------------------------------
I think that is a characteristic of how Yahoo is packaging and installing Hadoop rather than the project. I guess for now just add the tools jar to the end of the classpath after the user's jars. You'll need to make the change in trunk, 0.23 and 0.20.2xx.
We really should also fix the tools jar back to its old name (hadoop-tools-$version.jar), because otherwise upstream users can't find it.
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "John George (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13167627#comment-13167627 ]
John George commented on HADOOP-7810:
-------------------------------------
{quote}
Thanks for looking at it. I'm a bit confused, the trunk patch does only #1.
{quote}
I was looking at my own patch instead of the one you submitted! Sorry for the confusion.
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "John George (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168527#comment-13168527 ]
John George commented on HADOOP-7810:
-------------------------------------
I just finished testing this change on 0.23. All looks good. I did a simple 'create har' and then 'list har' test, just to ensure that the move to separate hars did work fine for each of the functionalities in those jars.
The only minor issue I saw was that I had to change hadoop-tools/pom.xml to reflect that it was '0.23.1-SNAPSHOT' and not '0.24'.
I am +1 pending the change to get it compiled on 0.23.
Good work Alejandro! Thanks a lot for doing this.
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) add hadoop-tools.jar to 'hadoop
classpath'
Posted by "John George (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147171#comment-13147171 ]
John George commented on HADOOP-7810:
-------------------------------------
I forgot that har was part of the hadoop-mapreduce-tools.jar in 0.23 and 0.24.
I was looking at the hadoop script in 0.23 and saw the following and assumed that "TOOL_PATH needs to be exported in 0.23 as well".
{code}
elif [ "$COMMAND" = "archive" ] ; then
CLASS=org.apache.hadoop.tools.HadoopArchives
CLASSPATH=${CLASSPATH}:${TOOL_PATH}
{code}
Updating the JIRA with branch-0.20-security as the version expected.
> add hadoop-tools.jar to 'hadoop classpath'
> ------------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0
> Reporter: John George
> Assignee: John George
> Fix For: 0.20.205.1
>
> Attachments: hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "Mahadev konar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168743#comment-13168743 ]
Mahadev konar commented on HADOOP-7810:
---------------------------------------
Looks like this is causing the build to fail https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1439. Can you please take a look?
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1, 1.0.0
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Fix For: 0.24.0, 0.23.1
>
> Attachments: HADOOP-7810v1-trunk.patch, HADOOP-7810v1-trunk.sh, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) move hadoop archive to core from
tools
Posted by "John George (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13149753#comment-13149753 ]
John George commented on HADOOP-7810:
-------------------------------------
Completed the testing I was planning to do:
1. Created HAR
2. listed files
3. sorted a HAR file
4. wc on a HAR file
> move hadoop archive to core from tools
> --------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.20.205.1
> Reporter: John George
> Assignee: John George
> Priority: Blocker
> Attachments: hadoop-7810.branch-0.20-security.patch, hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-7810) add hadoop-tools.jar to 'hadoop
classpath'
Posted by "Alejandro Abdelnur (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147164#comment-13147164 ]
Alejandro Abdelnur commented on HADOOP-7810:
--------------------------------------------
How this affects 0.23 and 0.24 which they don't produce a hadoop-tools JAR?
> add hadoop-tools.jar to 'hadoop classpath'
> ------------------------------------------
>
> Key: HADOOP-7810
> URL: https://issues.apache.org/jira/browse/HADOOP-7810
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 0.20.205.0, 0.24.0, 0.23.1
> Reporter: John George
> Assignee: John George
> Fix For: 0.20.205.1
>
> Attachments: hadoop-7810.branch-0.20-security.patch
>
>
> "The HadoopArchieves classes are included in the $HADOOP_HOME/hadoop_tools.jar, but this file is not found in `hadoop classpath`.
> A Pig script using HCatalog's dynamic partitioning with HAR enabled will therefore fail if a jar with HAR is not included in the pig call's '-cp' and '-Dpig.additional.jars' arguments."
> I am not aware of any reason to not include hadoop-tools.jar in 'hadoop classpath'. Will attach a patch soon.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira