You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Andrew Chalfant (JIRA)" <ji...@apache.org> on 2012/05/31 02:14:22 UTC
[jira] [Created] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Andrew Chalfant created HIVE-3068:
-------------------------------------
Summary: Add ability to export table metadata as JSON on table drop
Key: HIVE-3068
URL: https://issues.apache.org/jira/browse/HIVE-3068
Project: Hive
Issue Type: Bug
Components: Metastore, Serializers/Deserializers
Reporter: Andrew Chalfant
Priority: Minor
When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Andrew Chalfant (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13422612#comment-13422612 ]
Andrew Chalfant commented on HIVE-3068:
---------------------------------------
New revision is here: https://reviews.facebook.net/D4341
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Attachments: HIVE-3068.2.patch.txt
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446624#comment-13446624 ]
Hudson commented on HIVE-3068:
------------------------------
Integrated in Hive-trunk-h0.21 #1640 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1640/])
HIVE-3068 Export table metadata as JSON on table drop (Andrew Chalfant via egc) (Revision 1379683)
Result = FAILURE
ecapriolo : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1379683
Files :
* /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
* /hive/trunk/conf/hive-default.xml.template
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/MetaDataExportListener.java
* /hive/trunk/ql/src/test/queries/clientpositive/metadata_export_drop.q
* /hive/trunk/ql/src/test/results/clientpositive/metadata_export_drop.q.out
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Fix For: 0.9.0
>
> Attachments: HIVE-3068.2.patch.txt, hive-3068.patch.txt
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Andrew Chalfant (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436323#comment-13436323 ]
Andrew Chalfant commented on HIVE-3068:
---------------------------------------
pingping
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Attachments: HIVE-3068.2.patch.txt
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Andrew Chalfant (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Chalfant reassigned HIVE-3068:
-------------------------------------
Assignee: Andrew Chalfant
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13402767#comment-13402767 ]
Edward Capriolo commented on HIVE-3068:
---------------------------------------
We have done another issue for inport and export functions. Maybe you can borrow that code to dump the metadata instead of the json export you have done.
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Work started] (HIVE-3068) Add ability to export table
metadata as JSON on table drop
Posted by "Andrew Chalfant (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Work on HIVE-3068 started by Andrew Chalfant.
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13425008#comment-13425008 ]
Edward Capriolo commented on HIVE-3068:
---------------------------------------
My comments are inline in the patch
https://reviews.facebook.net/D4341
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Attachments: HIVE-3068.2.patch.txt
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Kevin Wilfong (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13425012#comment-13425012 ]
Kevin Wilfong commented on HIVE-3068:
-------------------------------------
Did you forget to hit Clowncopterize? I can't see them either.
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Attachments: HIVE-3068.2.patch.txt
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Andrew Chalfant (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Chalfant updated HIVE-3068:
----------------------------------
Attachment: HIVE-3068.2.patch.txt
Updated patch
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Attachments: HIVE-3068.2.patch.txt
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashutosh Chauhan updated HIVE-3068:
-----------------------------------
Fix Version/s: (was: 0.9.0)
0.10.0
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Fix For: 0.10.0
>
> Attachments: HIVE-3068.2.patch.txt, hive-3068.patch.txt
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward Capriolo updated HIVE-3068:
----------------------------------
Status: Open (was: Patch Available)
See comments in phabricator.
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Attachments: HIVE-3068.2.patch.txt
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Kevin Wilfong (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13410002#comment-13410002 ]
Kevin Wilfong commented on HIVE-3068:
-------------------------------------
I think he's referring to https://issues.apache.org/jira/browse/HIVE-1918
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13440877#comment-13440877 ]
Edward Capriolo commented on HIVE-3068:
---------------------------------------
Andrew. It is ok this patch took a little longer then it should have to get reviewed. I applied arc diff
https://reviews.facebook.net/D4341
You are missing the changes to the HiveConf.java and to the hive-site.xml.template make these changes and I will review.
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Attachments: HIVE-3068.2.patch.txt
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Andrew Chalfant (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Chalfant updated HIVE-3068:
----------------------------------
Issue Type: New Feature (was: Bug)
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13425500#comment-13425500 ]
Edward Capriolo commented on HIVE-3068:
---------------------------------------
I see I had no idea that the comments were not added until you touched a button named clowncopterize. I do not know why I did not figure this out, it is so intuitive.
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Attachments: HIVE-3068.2.patch.txt
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Andrew Chalfant (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13432348#comment-13432348 ]
Andrew Chalfant commented on HIVE-3068:
---------------------------------------
ping
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Attachments: HIVE-3068.2.patch.txt
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Andrew Chalfant (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13425005#comment-13425005 ]
Andrew Chalfant commented on HIVE-3068:
---------------------------------------
Hi Edward, is it possible that you didn't commit your comments? I don't see anything.
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Attachments: HIVE-3068.2.patch.txt
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13422614#comment-13422614 ]
Edward Capriolo commented on HIVE-3068:
---------------------------------------
I will look this over tonight.
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Attachments: HIVE-3068.2.patch.txt
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Andrew Chalfant (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13443768#comment-13443768 ]
Andrew Chalfant commented on HIVE-3068:
---------------------------------------
Added, thanks Edward!
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Attachments: HIVE-3068.2.patch.txt
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Andrew Chalfant (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13428776#comment-13428776 ]
Andrew Chalfant commented on HIVE-3068:
---------------------------------------
Okay, I have updated the diff to take parameterized locations and whether or not the file is deleted, so that we can test the existence of the subfolder int he export location with dfs -rmr (which throws and error if the path doesn't exist). This should resolve the issues you brought up last time.
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Attachments: HIVE-3068.2.patch.txt
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Andrew Chalfant (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13403594#comment-13403594 ]
Andrew Chalfant commented on HIVE-3068:
---------------------------------------
Can you point me to a diff, issue number, or where the code is located?
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Andrew Chalfant (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436983#comment-13436983 ]
Andrew Chalfant commented on HIVE-3068:
---------------------------------------
Sorry about that, did not realize it was a faux pas, won't happen again.
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Attachments: HIVE-3068.2.patch.txt
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13402765#comment-13402765 ]
Edward Capriolo commented on HIVE-3068:
---------------------------------------
+1 I like this. Add a unit test and we are good to go.
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436416#comment-13436416 ]
Edward Capriolo commented on HIVE-3068:
---------------------------------------
Dude don't do that. The average patch sits on the queue for some time and many committers volunteer time ill review ASAP.
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Attachments: HIVE-3068.2.patch.txt
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward Capriolo updated HIVE-3068:
----------------------------------
Attachment: hive-3068.patch.txt
Minor correction to patch
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Attachments: HIVE-3068.2.patch.txt, hive-3068.patch.txt
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Andrew Chalfant (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Chalfant updated HIVE-3068:
----------------------------------
Status: Patch Available (was: In Progress)
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Andrew Chalfant (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13399799#comment-13399799 ]
Andrew Chalfant commented on HIVE-3068:
---------------------------------------
Diff available here: https://reviews.facebook.net/D3795
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HIVE-3068) Add ability to export table metadata
as JSON on table drop
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward Capriolo resolved HIVE-3068.
-----------------------------------
Resolution: Fixed
Fix Version/s: 0.9.0
Release Note: Committed. Thanks Andrew.
Hadoop Flags: Reviewed
> Add ability to export table metadata as JSON on table drop
> ----------------------------------------------------------
>
> Key: HIVE-3068
> URL: https://issues.apache.org/jira/browse/HIVE-3068
> Project: Hive
> Issue Type: New Feature
> Components: Metastore, Serializers/Deserializers
> Reporter: Andrew Chalfant
> Assignee: Andrew Chalfant
> Priority: Minor
> Labels: features, newbie
> Fix For: 0.9.0
>
> Attachments: HIVE-3068.2.patch.txt, hive-3068.patch.txt
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When a table is dropped, the contents go to the users trash but the metadata is lost. It would be super neat to be able to save the metadata as well so that tables could be trivially re-instantiated via thrift.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira