You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Vikram Dixit K (JIRA)" <ji...@apache.org> on 2012/08/06 20:53:03 UTC
[jira] [Created] (HIVE-3338) Archives broken for hadoop 1.0
Vikram Dixit K created HIVE-3338:
------------------------------------
Summary: Archives broken for hadoop 1.0
Key: HIVE-3338
URL: https://issues.apache.org/jira/browse/HIVE-3338
Project: Hive
Issue Type: Bug
Components: Shims
Affects Versions: 0.9.0
Reporter: Vikram Dixit K
Hadoop archiving through hive is broken for 1.0. The hadoop archive command line and paths have changed for 1.0 and were not addressed in the shim layer.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3338) Archives broken for hadoop 1.0
Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashutosh Chauhan updated HIVE-3338:
-----------------------------------
Resolution: Fixed
Fix Version/s: 0.10.0
Status: Resolved (was: Patch Available)
Committed to trunk. Thanks, Vikram!
> Archives broken for hadoop 1.0
> ------------------------------
>
> Key: HIVE-3338
> URL: https://issues.apache.org/jira/browse/HIVE-3338
> Project: Hive
> Issue Type: Bug
> Components: Shims
> Affects Versions: 0.9.0
> Reporter: Vikram Dixit K
> Assignee: Vikram Dixit K
> Fix For: 0.10.0
>
> Attachments: HIVE-3338_2.patch, HIVE-3338_3.patch, HIVE-3338_4.patch, HIVE-3338_5.patch, HIVE-3338.patch
>
>
> Hadoop archiving through hive is broken for 1.0. The hadoop archive command line and paths have changed for 1.0 and were not addressed in the shim layer.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3338) Archives broken for hadoop 1.0
Posted by "Vikram Dixit K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vikram Dixit K updated HIVE-3338:
---------------------------------
Attachment: HIVE-3338_4.patch
build file change reverted.
> Archives broken for hadoop 1.0
> ------------------------------
>
> Key: HIVE-3338
> URL: https://issues.apache.org/jira/browse/HIVE-3338
> Project: Hive
> Issue Type: Bug
> Components: Shims
> Affects Versions: 0.9.0
> Reporter: Vikram Dixit K
> Attachments: HIVE-3338.patch, HIVE-3338_2.patch, HIVE-3338_3.patch, HIVE-3338_4.patch
>
>
> Hadoop archiving through hive is broken for 1.0. The hadoop archive command line and paths have changed for 1.0 and were not addressed in the shim layer.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3338) Archives broken for hadoop 1.0
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446893#comment-13446893 ]
Hudson commented on HIVE-3338:
------------------------------
Integrated in Hive-trunk-h0.21 #1642 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1642/])
HIVE-3338 : Archives broken for hadoop 1.0 (Vikram Dixit via Ashutosh Chauhan) (Revision 1379908)
Result = FAILURE
hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1379908
Files :
* /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
* /hive/trunk/conf/hive-default.xml.template
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/ArchiveUtils.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java
* /hive/trunk/ql/src/test/queries/clientpositive/archive.q
* /hive/trunk/ql/src/test/queries/clientpositive/archive_excludeHadoop20.q
* /hive/trunk/ql/src/test/results/clientpositive/archive.q.out
* /hive/trunk/ql/src/test/results/clientpositive/archive_excludeHadoop20.q.out
* /hive/trunk/shims/src/0.20/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java
* /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java
* /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/HadoopShims.java
> Archives broken for hadoop 1.0
> ------------------------------
>
> Key: HIVE-3338
> URL: https://issues.apache.org/jira/browse/HIVE-3338
> Project: Hive
> Issue Type: Bug
> Components: Shims
> Affects Versions: 0.9.0
> Reporter: Vikram Dixit K
> Assignee: Vikram Dixit K
> Fix For: 0.10.0
>
> Attachments: HIVE-3338_2.patch, HIVE-3338_3.patch, HIVE-3338_4.patch, HIVE-3338_5.patch, HIVE-3338.patch
>
>
> Hadoop archiving through hive is broken for 1.0. The hadoop archive command line and paths have changed for 1.0 and were not addressed in the shim layer.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3338) Archives broken for hadoop 1.0
Posted by "Vikram Dixit K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vikram Dixit K updated HIVE-3338:
---------------------------------
Attachment: HIVE-3338.patch
> Archives broken for hadoop 1.0
> ------------------------------
>
> Key: HIVE-3338
> URL: https://issues.apache.org/jira/browse/HIVE-3338
> Project: Hive
> Issue Type: Bug
> Components: Shims
> Affects Versions: 0.9.0
> Reporter: Vikram Dixit K
> Attachments: HIVE-3338.patch
>
>
> Hadoop archiving through hive is broken for 1.0. The hadoop archive command line and paths have changed for 1.0 and were not addressed in the shim layer.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3338) Archives broken for hadoop 1.0
Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13432366#comment-13432366 ]
Ashutosh Chauhan commented on HIVE-3338:
----------------------------------------
@Vikram,
Can you create either a phabricator or review board entry of your patch ?
> Archives broken for hadoop 1.0
> ------------------------------
>
> Key: HIVE-3338
> URL: https://issues.apache.org/jira/browse/HIVE-3338
> Project: Hive
> Issue Type: Bug
> Components: Shims
> Affects Versions: 0.9.0
> Reporter: Vikram Dixit K
> Attachments: HIVE-3338.patch, HIVE-3338_2.patch, HIVE-3338_3.patch, HIVE-3338_4.patch
>
>
> Hadoop archiving through hive is broken for 1.0. The hadoop archive command line and paths have changed for 1.0 and were not addressed in the shim layer.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3338) Archives broken for hadoop 1.0
Posted by "Vikram Dixit K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13429346#comment-13429346 ]
Vikram Dixit K commented on HIVE-3338:
--------------------------------------
<a href=https://issues.apache.org/jira/browse/HIVE-3025?focusedCommentId=13422589&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13422589>Link</a> to comment
> Archives broken for hadoop 1.0
> ------------------------------
>
> Key: HIVE-3338
> URL: https://issues.apache.org/jira/browse/HIVE-3338
> Project: Hive
> Issue Type: Bug
> Components: Shims
> Affects Versions: 0.9.0
> Reporter: Vikram Dixit K
>
> Hadoop archiving through hive is broken for 1.0. The hadoop archive command line and paths have changed for 1.0 and were not addressed in the shim layer.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3338) Archives broken for hadoop 1.0
Posted by "Vikram Dixit K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13429348#comment-13429348 ]
Vikram Dixit K commented on HIVE-3338:
--------------------------------------
There is one issue that is not resolved. For the archive.q test, the golden results with 0.20 hadoop seem incorrect.
The last queries are:
SELECT SUM(hash(col)) FROM (SELECT transform(*) using 'tr "\t" "_"' AS col
FROM (SELECT * FROM old_name WHERE ds='1') subq1) subq2;
ALTER TABLE old_name RENAME TO new_name;
SELECT SUM(hash(col)) FROM (SELECT transform(*) using 'tr "\t" "_"' AS col
FROM (SELECT * FROM new_name WHERE ds='1') subq1) subq2;
The select queries seem to produce different results in 20. The first one produces 48656137. But, after rename of the table, it produces NULL. This doesn't make sense to me. With my changes for 1.0, I see the proper results of 48656137 in both cases. It would be great if someone can explain to me why we expect NULL in the case of 20.
Thanks,
Vikram
> Archives broken for hadoop 1.0
> ------------------------------
>
> Key: HIVE-3338
> URL: https://issues.apache.org/jira/browse/HIVE-3338
> Project: Hive
> Issue Type: Bug
> Components: Shims
> Affects Versions: 0.9.0
> Reporter: Vikram Dixit K
> Attachments: HIVE-3338.patch
>
>
> Hadoop archiving through hive is broken for 1.0. The hadoop archive command line and paths have changed for 1.0 and were not addressed in the shim layer.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3338) Archives broken for hadoop 1.0
Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13437391#comment-13437391 ]
Ashutosh Chauhan commented on HIVE-3338:
----------------------------------------
Vikram,
I left some comments on https://reviews.apache.org/r/6533/
Also patch needs to be rebased.
> Archives broken for hadoop 1.0
> ------------------------------
>
> Key: HIVE-3338
> URL: https://issues.apache.org/jira/browse/HIVE-3338
> Project: Hive
> Issue Type: Bug
> Components: Shims
> Affects Versions: 0.9.0
> Reporter: Vikram Dixit K
> Assignee: Vikram Dixit K
> Attachments: HIVE-3338_2.patch, HIVE-3338_3.patch, HIVE-3338_4.patch, HIVE-3338.patch
>
>
> Hadoop archiving through hive is broken for 1.0. The hadoop archive command line and paths have changed for 1.0 and were not addressed in the shim layer.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3338) Archives broken for hadoop 1.0
Posted by "Vikram Dixit K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vikram Dixit K updated HIVE-3338:
---------------------------------
Status: Patch Available (was: Open)
> Archives broken for hadoop 1.0
> ------------------------------
>
> Key: HIVE-3338
> URL: https://issues.apache.org/jira/browse/HIVE-3338
> Project: Hive
> Issue Type: Bug
> Components: Shims
> Affects Versions: 0.9.0
> Reporter: Vikram Dixit K
> Attachments: HIVE-3338.patch
>
>
> Hadoop archiving through hive is broken for 1.0. The hadoop archive command line and paths have changed for 1.0 and were not addressed in the shim layer.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3338) Archives broken for hadoop 1.0
Posted by "Vikram Dixit K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vikram Dixit K updated HIVE-3338:
---------------------------------
Attachment: HIVE-3338_5.patch
Addressed Ashutosh's comments.
> Archives broken for hadoop 1.0
> ------------------------------
>
> Key: HIVE-3338
> URL: https://issues.apache.org/jira/browse/HIVE-3338
> Project: Hive
> Issue Type: Bug
> Components: Shims
> Affects Versions: 0.9.0
> Reporter: Vikram Dixit K
> Assignee: Vikram Dixit K
> Attachments: HIVE-3338_2.patch, HIVE-3338_3.patch, HIVE-3338_4.patch, HIVE-3338_5.patch, HIVE-3338.patch
>
>
> Hadoop archiving through hive is broken for 1.0. The hadoop archive command line and paths have changed for 1.0 and were not addressed in the shim layer.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3338) Archives broken for hadoop 1.0
Posted by "Vikram Dixit K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vikram Dixit K updated HIVE-3338:
---------------------------------
Attachment: HIVE-3338_2.patch
This resolves the issues in 1.0. The renaming of an archived table does not work in case of 20. This patch does not address that issue.
> Archives broken for hadoop 1.0
> ------------------------------
>
> Key: HIVE-3338
> URL: https://issues.apache.org/jira/browse/HIVE-3338
> Project: Hive
> Issue Type: Bug
> Components: Shims
> Affects Versions: 0.9.0
> Reporter: Vikram Dixit K
> Attachments: HIVE-3338.patch, HIVE-3338_2.patch
>
>
> Hadoop archiving through hive is broken for 1.0. The hadoop archive command line and paths have changed for 1.0 and were not addressed in the shim layer.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3338) Archives broken for hadoop 1.0
Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446632#comment-13446632 ]
Ashutosh Chauhan commented on HIVE-3338:
----------------------------------------
+1 will commit if tests pass.
> Archives broken for hadoop 1.0
> ------------------------------
>
> Key: HIVE-3338
> URL: https://issues.apache.org/jira/browse/HIVE-3338
> Project: Hive
> Issue Type: Bug
> Components: Shims
> Affects Versions: 0.9.0
> Reporter: Vikram Dixit K
> Assignee: Vikram Dixit K
> Attachments: HIVE-3338_2.patch, HIVE-3338_3.patch, HIVE-3338_4.patch, HIVE-3338_5.patch, HIVE-3338.patch
>
>
> Hadoop archiving through hive is broken for 1.0. The hadoop archive command line and paths have changed for 1.0 and were not addressed in the shim layer.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-3338) Archives broken for hadoop 1.0
Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashutosh Chauhan reassigned HIVE-3338:
--------------------------------------
Assignee: Vikram Dixit K
> Archives broken for hadoop 1.0
> ------------------------------
>
> Key: HIVE-3338
> URL: https://issues.apache.org/jira/browse/HIVE-3338
> Project: Hive
> Issue Type: Bug
> Components: Shims
> Affects Versions: 0.9.0
> Reporter: Vikram Dixit K
> Assignee: Vikram Dixit K
> Attachments: HIVE-3338.patch, HIVE-3338_2.patch, HIVE-3338_3.patch, HIVE-3338_4.patch
>
>
> Hadoop archiving through hive is broken for 1.0. The hadoop archive command line and paths have changed for 1.0 and were not addressed in the shim layer.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3338) Archives broken for hadoop 1.0
Posted by "Vikram Dixit K (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vikram Dixit K updated HIVE-3338:
---------------------------------
Attachment: HIVE-3338_3.patch
Missed the .out file for the new test.
> Archives broken for hadoop 1.0
> ------------------------------
>
> Key: HIVE-3338
> URL: https://issues.apache.org/jira/browse/HIVE-3338
> Project: Hive
> Issue Type: Bug
> Components: Shims
> Affects Versions: 0.9.0
> Reporter: Vikram Dixit K
> Attachments: HIVE-3338.patch, HIVE-3338_2.patch, HIVE-3338_3.patch
>
>
> Hadoop archiving through hive is broken for 1.0. The hadoop archive command line and paths have changed for 1.0 and were not addressed in the shim layer.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira