You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Nadeem Moidu (JIRA)" <ji...@apache.org> on 2012/06/01 03:05:23 UTC

[jira] [Created] (HIVE-3074) Create a new API which gets a new empty partition object.

Nadeem Moidu created HIVE-3074:
----------------------------------

             Summary: Create a new API which gets a new empty partition object.
                 Key: HIVE-3074
                 URL: https://issues.apache.org/jira/browse/HIVE-3074
             Project: Hive
          Issue Type: New Feature
            Reporter: Nadeem Moidu




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain updated HIVE-3074:
-----------------------------

    Status: Patch Available  (was: Open)
    
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>          Components: Metastore
>            Reporter: Nadeem Moidu
>            Assignee: Namit Jain
>         Attachments: HIVE-3074.1.patch, hive.3074.1.patch
>
>
> Gets a new partition object with the given parameters. Similar to append_partition, but does not add the partition to metastore. It only works for tables; does not work for other objects like views. The table is fetched from the metastore using the db name and the table name.  However, the actual partition is not fetched from the metastore. It does not matter whether the partition exists or not.The partition values are used to construct a new partition.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13287836#comment-13287836 ] 

Edward Capriolo commented on HIVE-3074:
---------------------------------------

Q. Why would one want an empty partition?
                
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain updated HIVE-3074:
-----------------------------

    Status: Open  (was: Patch Available)

minor comments
                
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>
> Gets a new partition object with the given parameters. Similar to append_partition, but does not add the partition to metastore. It only works for tables; does not work for other objects like views. The table is fetched from the metastore using the db name and the table name.  However, the actual partition is not fetched from the metastore. It does not matter whether the partition exists or not.The partition values are used to construct a new partition.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13427155#comment-13427155 ] 

Namit Jain commented on HIVE-3074:
----------------------------------

https://reviews.facebook.net/D4485

Addressed all comments from the previous review.
Added negative tests for views etc.
                
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>          Components: Metastore
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>         Attachments: HIVE-3074.1.patch, hive.3074.1.patch
>
>
> Gets a new partition object with the given parameters. Similar to append_partition, but does not add the partition to metastore. It only works for tables; does not work for other objects like views. The table is fetched from the metastore using the db name and the table name.  However, the actual partition is not fetched from the metastore. It does not matter whether the partition exists or not.The partition values are used to construct a new partition.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Nadeem Moidu (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nadeem Moidu updated HIVE-3074:
-------------------------------

    Description: Gets a new partition object with the given parameters. Similar to append_partition, but does not add the partition to metastore. It only works for tables; does not work for other objects like views. The table is fetched from the metastore using the db name and the table name.  However, the actual partition is not fetched from the metastore. It does not matter whether the partition exists or not.The partition values are used to construct a new partition.
    
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>
> Gets a new partition object with the given parameters. Similar to append_partition, but does not add the partition to metastore. It only works for tables; does not work for other objects like views. The table is fetched from the metastore using the db name and the table name.  However, the actual partition is not fetched from the metastore. It does not matter whether the partition exists or not.The partition values are used to construct a new partition.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Assigned] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain reassigned HIVE-3074:
--------------------------------

    Assignee: Namit Jain  (was: Nadeem Moidu)
    
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>          Components: Metastore
>            Reporter: Nadeem Moidu
>            Assignee: Namit Jain
>         Attachments: HIVE-3074.1.patch, hive.3074.1.patch
>
>
> Gets a new partition object with the given parameters. Similar to append_partition, but does not add the partition to metastore. It only works for tables; does not work for other objects like views. The table is fetched from the metastore using the db name and the table name.  However, the actual partition is not fetched from the metastore. It does not matter whether the partition exists or not.The partition values are used to construct a new partition.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13294779#comment-13294779 ] 

Carl Steinbach commented on HIVE-3074:
--------------------------------------

@Namit

{quote}
One of the common use-cases we see is that people want to create a new partition object using the thrift API. Today, the only way to perform that is to get a existing partition object, modify it manually (location, partition valus etc.), modify some other properties (which are application dependent) and then add the partition. This process is error prone, since it is manual.
{quote}

The Thrift API also allows you to add partitions using these methods:

{noformat}
  Partition append_partition(1:string db_name, 2:string tbl_name, 3:list<string> part_vals)
                       throws (1:InvalidObjectException o1, 2:AlreadyExistsException o2, 3:MetaException o3)
  Partition append_partition_by_name(1:string db_name, 2:string tbl_name, 3:string part_name)
                       throws (1:InvalidObjectException o1, 2:AlreadyExistsException o2, 3:MetaException o3)
{noformat}

In what ways do these two methods not satisfy your use case?

                
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>
> Gets a new partition object with the given parameters. Similar to append_partition, but does not add the partition to metastore. It only works for tables; does not work for other objects like views. The table is fetched from the metastore using the db name and the table name.  However, the actual partition is not fetched from the metastore. It does not matter whether the partition exists or not.The partition values are used to construct a new partition.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13288360#comment-13288360 ] 

Namit Jain commented on HIVE-3074:
----------------------------------

One of the common use-cases we see is that people want to create a new partition object using the thrift API.
Today, the only way to perform that is to get a existing partition object, modify it manually (location, partition valus etc.),
modify some other properties (which are application dependent) and then add the partition. This process is error prone, since it is
manual.

The purpose of this API is to let the users get the partition assuming no manual process. It is similar to append_partition without the
partition actually being created. The user can modify it, and then decide to add it, or change it.
                
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain updated HIVE-3074:
-----------------------------

    Attachment: hive.3074.1.patch
    
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>          Components: Metastore
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>         Attachments: HIVE-3074.1.patch, hive.3074.1.patch
>
>
> Gets a new partition object with the given parameters. Similar to append_partition, but does not add the partition to metastore. It only works for tables; does not work for other objects like views. The table is fetched from the metastore using the db name and the table name.  However, the actual partition is not fetched from the metastore. It does not matter whether the partition exists or not.The partition values are used to construct a new partition.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Nadeem Moidu (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nadeem Moidu updated HIVE-3074:
-------------------------------

    Status: Patch Available  (was: Open)

Updated according to Carl's comments.
                
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>          Components: Metastore
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>
> Gets a new partition object with the given parameters. Similar to append_partition, but does not add the partition to metastore. It only works for tables; does not work for other objects like views. The table is fetched from the metastore using the db name and the table name.  However, the actual partition is not fetched from the metastore. It does not matter whether the partition exists or not.The partition values are used to construct a new partition.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13294819#comment-13294819 ] 

Namit Jain commented on HIVE-3074:
----------------------------------

@Carl, Edward answered it correctly.
                
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>          Components: Metastore
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>
> Gets a new partition object with the given parameters. Similar to append_partition, but does not add the partition to metastore. It only works for tables; does not work for other objects like views. The table is fetched from the metastore using the db name and the table name.  However, the actual partition is not fetched from the metastore. It does not matter whether the partition exists or not.The partition values are used to construct a new partition.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Nadeem Moidu (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nadeem Moidu updated HIVE-3074:
-------------------------------

    Assignee: Nadeem Moidu
      Status: Patch Available  (was: Open)
    
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295902#comment-13295902 ] 

Carl Steinbach commented on HIVE-3074:
--------------------------------------

@Nadeem: Please see my comments on phabricator. TestHiveMetaStore fails with the most recent version of your patch. Also, these patches need to be attached to this ticket before the patch gets committed. Thanks.

@Namit: I'm still trying to understand why we need this new metastore function. If append_partition() is deficient in some way, wouldn't it make more sense to fix that problem instead of adding yet another metastore function?
                
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>          Components: Metastore
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>
> Gets a new partition object with the given parameters. Similar to append_partition, but does not add the partition to metastore. It only works for tables; does not work for other objects like views. The table is fetched from the metastore using the db name and the table name.  However, the actual partition is not fetched from the metastore. It does not matter whether the partition exists or not.The partition values are used to construct a new partition.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295247#comment-13295247 ] 

Namit Jain commented on HIVE-3074:
----------------------------------

@Carl, append_partition adds a new partition to the metastore.

This new API does not add a new partition. It creates a new partition as it would exist in memory, and returns it back to you.
The user can modify it and flush it later.
                
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>          Components: Metastore
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>
> Gets a new partition object with the given parameters. Similar to append_partition, but does not add the partition to metastore. It only works for tables; does not work for other objects like views. The table is fetched from the metastore using the db name and the table name.  However, the actual partition is not fetched from the metastore. It does not matter whether the partition exists or not.The partition values are used to construct a new partition.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13288771#comment-13288771 ] 

Edward Capriolo commented on HIVE-3074:
---------------------------------------

+1 to the idea.
                
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain updated HIVE-3074:
-----------------------------

    Status: Patch Available  (was: Open)
    
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>
> Gets a new partition object with the given parameters. Similar to append_partition, but does not add the partition to metastore. It only works for tables; does not work for other objects like views. The table is fetched from the metastore using the db name and the table name.  However, the actual partition is not fetched from the metastore. It does not matter whether the partition exists or not.The partition values are used to construct a new partition.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13294790#comment-13294790 ] 

Edward Capriolo commented on HIVE-3074:
---------------------------------------

I think they want a shallow object to play with before writing back.
                
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>          Components: Metastore
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>
> Gets a new partition object with the given parameters. Similar to append_partition, but does not add the partition to metastore. It only works for tables; does not work for other objects like views. The table is fetched from the metastore using the db name and the table name.  However, the actual partition is not fetched from the metastore. It does not matter whether the partition exists or not.The partition values are used to construct a new partition.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295248#comment-13295248 ] 

Carl Steinbach commented on HIVE-3074:
--------------------------------------

bq. The user can modify it and flush it later.

By "flush" do you mean persist it back to the metastore?

                
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>          Components: Metastore
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>
> Gets a new partition object with the given parameters. Similar to append_partition, but does not add the partition to metastore. It only works for tables; does not work for other objects like views. The table is fetched from the metastore using the db name and the table name.  However, the actual partition is not fetched from the metastore. It does not matter whether the partition exists or not.The partition values are used to construct a new partition.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach updated HIVE-3074:
---------------------------------

    Component/s: Metastore
    
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>          Components: Metastore
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>
> Gets a new partition object with the given parameters. Similar to append_partition, but does not add the partition to metastore. It only works for tables; does not work for other objects like views. The table is fetched from the metastore using the db name and the table name.  However, the actual partition is not fetched from the metastore. It does not matter whether the partition exists or not.The partition values are used to construct a new partition.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach updated HIVE-3074:
---------------------------------

    Status: Open  (was: Patch Available)

@Nadeem: I added some comments on phabricator. Thanks.
                
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>
> Gets a new partition object with the given parameters. Similar to append_partition, but does not add the partition to metastore. It only works for tables; does not work for other objects like views. The table is fetched from the metastore using the db name and the table name.  However, the actual partition is not fetched from the metastore. It does not matter whether the partition exists or not.The partition values are used to construct a new partition.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Nadeem Moidu (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13287812#comment-13287812 ] 

Nadeem Moidu commented on HIVE-3074:
------------------------------------

https://reviews.facebook.net/D3477
                
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>            Reporter: Nadeem Moidu
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13427116#comment-13427116 ] 

Namit Jain commented on HIVE-3074:
----------------------------------

It is different from append_partition.
The idea here is to get a existing partition template, append_partition creates a new partition.
We can add another parameter to append_partition, but that would be very confusing, given the name
append.


                
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>          Components: Metastore
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>         Attachments: HIVE-3074.1.patch
>
>
> Gets a new partition object with the given parameters. Similar to append_partition, but does not add the partition to metastore. It only works for tables; does not work for other objects like views. The table is fetched from the metastore using the db name and the table name.  However, the actual partition is not fetched from the metastore. It does not matter whether the partition exists or not.The partition values are used to construct a new partition.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain updated HIVE-3074:
-----------------------------

    Status: Open  (was: Patch Available)
    
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13294870#comment-13294870 ] 

Carl Steinbach commented on HIVE-3074:
--------------------------------------

@Namit: I don't understand what Ed means by "... a shallow object to play with before writing back". Maybe you can explain it to me? Better yet, can you please tell me why the existing append_partition() methods don't work for you?
                
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>          Components: Metastore
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>
> Gets a new partition object with the given parameters. Similar to append_partition, but does not add the partition to metastore. It only works for tables; does not work for other objects like views. The table is fetched from the metastore using the db name and the table name.  However, the actual partition is not fetched from the metastore. It does not matter whether the partition exists or not.The partition values are used to construct a new partition.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Nadeem Moidu (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nadeem Moidu updated HIVE-3074:
-------------------------------

    Attachment: HIVE-3074.1.patch
    
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>          Components: Metastore
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>         Attachments: HIVE-3074.1.patch
>
>
> Gets a new partition object with the given parameters. Similar to append_partition, but does not add the partition to metastore. It only works for tables; does not work for other objects like views. The table is fetched from the metastore using the db name and the table name.  However, the actual partition is not fetched from the metastore. It does not matter whether the partition exists or not.The partition values are used to construct a new partition.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach updated HIVE-3074:
---------------------------------

    Status: Open  (was: Patch Available)
    
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>          Components: Metastore
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>
> Gets a new partition object with the given parameters. Similar to append_partition, but does not add the partition to metastore. It only works for tables; does not work for other objects like views. The table is fetched from the metastore using the db name and the table name.  However, the actual partition is not fetched from the metastore. It does not matter whether the partition exists or not.The partition values are used to construct a new partition.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-3074) Create a new API which gets a new empty partition object.

Posted by "Nadeem Moidu (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nadeem Moidu updated HIVE-3074:
-------------------------------

    Status: Patch Available  (was: Open)
    
> Create a new API which gets a new empty partition object.
> ---------------------------------------------------------
>
>                 Key: HIVE-3074
>                 URL: https://issues.apache.org/jira/browse/HIVE-3074
>             Project: Hive
>          Issue Type: New Feature
>            Reporter: Nadeem Moidu
>            Assignee: Nadeem Moidu
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira