You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Johan Oskarsson (JIRA)" <ji...@apache.org> on 2008/12/09 13:00:44 UTC

[jira] Created: (HIVE-143) Remove the old Metastore

Remove the old Metastore
------------------------

                 Key: HIVE-143
                 URL: https://issues.apache.org/jira/browse/HIVE-143
             Project: Hadoop Hive
          Issue Type: Improvement
          Components: Metastore
    Affects Versions: 0.19.0
            Reporter: Johan Oskarsson
            Priority: Minor
             Fix For: 0.19.0


It is my understanding that there are two metastores, one HDFS based that isn't being used anymore and one new based on SQL databases. This causes some confusion and extra work for new developers, myself included. Am I correct in thinking that the old Metastore won't be used anymore and could be removed?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-143) Remove the old Metastore

Posted by "Ashish Thusoo (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12655318#action_12655318 ] 

Ashish Thusoo commented on HIVE-143:
------------------------------------

A number of functions for partitions and type are no ops in the file based metastore. Look at HiveMetaStoreClient.java, HiveMetaStore.java (RDBMS based metastore) and MetaStoreClient.java and MetaStore.java (File based metastore) to see the differences.

I would wait for Pete and Prasad to be back (they will be back next week) before phasing this out.

My vote is to phase the File based one out but we should hear from those two, specially from Pete who did the original File based metastore.


> Remove the old Metastore
> ------------------------
>
>                 Key: HIVE-143
>                 URL: https://issues.apache.org/jira/browse/HIVE-143
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Metastore
>    Affects Versions: 0.19.0
>            Reporter: Johan Oskarsson
>            Priority: Minor
>             Fix For: 0.19.0
>
>
> It is my understanding that there are two metastores, one HDFS based that isn't being used anymore and one new based on SQL databases. This causes some confusion and extra work for new developers, myself included. Am I correct in thinking that the old Metastore won't be used anymore and could be removed?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-143) Remove the old Metastore

Posted by "Prasad Chakka (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Prasad Chakka updated HIVE-143:
-------------------------------

    Affects Version/s: 0.4.0
                       0.3.1
                       0.3.0
                       0.2.0
               Status: Patch Available  (was: Open)

> Remove the old Metastore
> ------------------------
>
>                 Key: HIVE-143
>                 URL: https://issues.apache.org/jira/browse/HIVE-143
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Metastore
>    Affects Versions: 0.2.0, 0.3.0, 0.3.1, 0.4.0
>            Reporter: Johan Oskarsson
>            Assignee: Prasad Chakka
>            Priority: Minor
>             Fix For: 0.4.0
>
>         Attachments: hive-143.patch
>
>
> It is my understanding that there are two metastores, one HDFS based that isn't being used anymore and one new based on SQL databases. This causes some confusion and extra work for new developers, myself included. Am I correct in thinking that the old Metastore won't be used anymore and could be removed?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-143) Remove the old Metastore

Posted by "Ashish Thusoo (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12654825#action_12654825 ] 

Ashish Thusoo commented on HIVE-143:
------------------------------------

Not hdfs based, but the old one is based on the local file system.

It can potentially be removed, though that warrants a discussion here. There are some fairly significant pieces of functionality missing from the old one as we are not actively developing that metastore. However, if someone feels that they can find potential use for it and would want to develop it further, then we could just keep it around in the code.


> Remove the old Metastore
> ------------------------
>
>                 Key: HIVE-143
>                 URL: https://issues.apache.org/jira/browse/HIVE-143
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Metastore
>    Affects Versions: 0.19.0
>            Reporter: Johan Oskarsson
>            Priority: Minor
>             Fix For: 0.19.0
>
>
> It is my understanding that there are two metastores, one HDFS based that isn't being used anymore and one new based on SQL databases. This causes some confusion and extra work for new developers, myself included. Am I correct in thinking that the old Metastore won't be used anymore and could be removed?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-143) Remove the old Metastore

Posted by "Prasad Chakka (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Prasad Chakka updated HIVE-143:
-------------------------------

    Attachment: hive-143.patch

removed the file based metastore code

> Remove the old Metastore
> ------------------------
>
>                 Key: HIVE-143
>                 URL: https://issues.apache.org/jira/browse/HIVE-143
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Metastore
>    Affects Versions: 0.2.0, 0.3.0, 0.3.1, 0.4.0
>            Reporter: Johan Oskarsson
>            Assignee: Prasad Chakka
>            Priority: Minor
>             Fix For: 0.4.0
>
>         Attachments: hive-143.patch
>
>
> It is my understanding that there are two metastores, one HDFS based that isn't being used anymore and one new based on SQL databases. This causes some confusion and extra work for new developers, myself included. Am I correct in thinking that the old Metastore won't be used anymore and could be removed?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-143) Remove the old Metastore

Posted by "Johan Oskarsson (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Johan Oskarsson updated HIVE-143:
---------------------------------

    Fix Version/s:     (was: 0.2.0)
                   0.4.0

> Remove the old Metastore
> ------------------------
>
>                 Key: HIVE-143
>                 URL: https://issues.apache.org/jira/browse/HIVE-143
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Metastore
>            Reporter: Johan Oskarsson
>            Assignee: Prasad Chakka
>            Priority: Minor
>             Fix For: 0.4.0
>
>
> It is my understanding that there are two metastores, one HDFS based that isn't being used anymore and one new based on SQL databases. This causes some confusion and extra work for new developers, myself included. Am I correct in thinking that the old Metastore won't be used anymore and could be removed?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-143) Remove the old Metastore

Posted by "Johan Oskarsson (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Johan Oskarsson updated HIVE-143:
---------------------------------

      Resolution: Fixed
    Release Note: HIVE-143. Remove the old file based metastore, in favour of the RDBMS based metastore. (prasadc via johan)
    Hadoop Flags: [Incompatible change, Reviewed]
          Status: Resolved  (was: Patch Available)

Committed revision 765271. Thanks Prasad!

> Remove the old Metastore
> ------------------------
>
>                 Key: HIVE-143
>                 URL: https://issues.apache.org/jira/browse/HIVE-143
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Metastore
>    Affects Versions: 0.2.0, 0.3.0, 0.3.1, 0.4.0
>            Reporter: Johan Oskarsson
>            Assignee: Prasad Chakka
>            Priority: Minor
>             Fix For: 0.4.0
>
>         Attachments: hive-143.patch
>
>
> It is my understanding that there are two metastores, one HDFS based that isn't being used anymore and one new based on SQL databases. This causes some confusion and extra work for new developers, myself included. Am I correct in thinking that the old Metastore won't be used anymore and could be removed?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (HIVE-143) Remove the old Metastore

Posted by "Johan Oskarsson (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Johan Oskarsson reassigned HIVE-143:
------------------------------------

    Assignee: Prasad Chakka

Assigning to someone who knows more about this

> Remove the old Metastore
> ------------------------
>
>                 Key: HIVE-143
>                 URL: https://issues.apache.org/jira/browse/HIVE-143
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Metastore
>            Reporter: Johan Oskarsson
>            Assignee: Prasad Chakka
>            Priority: Minor
>             Fix For: 0.2.0
>
>
> It is my understanding that there are two metastores, one HDFS based that isn't being used anymore and one new based on SQL databases. This causes some confusion and extra work for new developers, myself included. Am I correct in thinking that the old Metastore won't be used anymore and could be removed?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-143) Remove the old Metastore

Posted by "Johan Oskarsson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12655182#action_12655182 ] 

Johan Oskarsson commented on HIVE-143:
--------------------------------------

Ashish: Could you give an example of what is missing in the old version?
Everyone else: Does anyone have a need to use the file based version or could it be phased out?

> Remove the old Metastore
> ------------------------
>
>                 Key: HIVE-143
>                 URL: https://issues.apache.org/jira/browse/HIVE-143
>             Project: Hadoop Hive
>          Issue Type: Improvement
>          Components: Metastore
>    Affects Versions: 0.19.0
>            Reporter: Johan Oskarsson
>            Priority: Minor
>             Fix For: 0.19.0
>
>
> It is my understanding that there are two metastores, one HDFS based that isn't being used anymore and one new based on SQL databases. This causes some confusion and extra work for new developers, myself included. Am I correct in thinking that the old Metastore won't be used anymore and could be removed?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.