You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Namit Jain (JIRA)" <ji...@apache.org> on 2010/05/19 00:26:43 UTC

[jira] Created: (HIVE-1350) hive.query.id is not unique

hive.query.id is not unique 
----------------------------

                 Key: HIVE-1350
                 URL: https://issues.apache.org/jira/browse/HIVE-1350
             Project: Hadoop Hive
          Issue Type: Bug
            Reporter: Namit Jain
            Assignee: Namit Jain


if commands are executed by the same user within a second

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-1350) hive.query.id is not unique

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12868951#action_12868951 ] 

Namit Jain commented on HIVE-1350:
----------------------------------

added UUID

> hive.query.id is not unique 
> ----------------------------
>
>                 Key: HIVE-1350
>                 URL: https://issues.apache.org/jira/browse/HIVE-1350
>             Project: Hadoop Hive
>          Issue Type: Bug
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>         Attachments: hive.1350.1.patch, hive.1350.2.patch
>
>
> if commands are executed by the same user within a second

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-1350) hive.query.id is not unique

Posted by "John Sichi (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12868884#action_12868884 ] 

John Sichi commented on HIVE-1350:
----------------------------------

Random with no args is seeded by current time in millis, so when run from two different JVM's there's still a tiny chance that we can end up with the same query ID.  If we want to avoid that, we can use UUID instead:

http://java.sun.com/j2se/1.5.0/docs/api/java/util/UUID.html

But if we only care about uniqueness within the same JVM, then +1.


> hive.query.id is not unique 
> ----------------------------
>
>                 Key: HIVE-1350
>                 URL: https://issues.apache.org/jira/browse/HIVE-1350
>             Project: Hadoop Hive
>          Issue Type: Bug
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>         Attachments: hive.1350.1.patch
>
>
> if commands are executed by the same user within a second

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-1350) hive.query.id is not unique

Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ning Zhang updated HIVE-1350:
-----------------------------

        Status: Resolved  (was: Patch Available)
    Resolution: Fixed

Committed. Thanks Namit and John!


> hive.query.id is not unique 
> ----------------------------
>
>                 Key: HIVE-1350
>                 URL: https://issues.apache.org/jira/browse/HIVE-1350
>             Project: Hadoop Hive
>          Issue Type: Bug
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>         Attachments: hive.1350.1.patch, hive.1350.2.patch
>
>
> if commands are executed by the same user within a second

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-1350) hive.query.id is not unique

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain updated HIVE-1350:
-----------------------------

    Attachment: hive.1350.2.patch

> hive.query.id is not unique 
> ----------------------------
>
>                 Key: HIVE-1350
>                 URL: https://issues.apache.org/jira/browse/HIVE-1350
>             Project: Hadoop Hive
>          Issue Type: Bug
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>         Attachments: hive.1350.1.patch, hive.1350.2.patch
>
>
> if commands are executed by the same user within a second

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-1350) hive.query.id is not unique

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain updated HIVE-1350:
-----------------------------

    Attachment: hive.1350.1.patch

> hive.query.id is not unique 
> ----------------------------
>
>                 Key: HIVE-1350
>                 URL: https://issues.apache.org/jira/browse/HIVE-1350
>             Project: Hadoop Hive
>          Issue Type: Bug
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>         Attachments: hive.1350.1.patch
>
>
> if commands are executed by the same user within a second

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-1350) hive.query.id is not unique

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12868916#action_12868916 ] 

Carl Steinbach commented on HIVE-1350:
--------------------------------------

+1 for using UUIDs


> hive.query.id is not unique 
> ----------------------------
>
>                 Key: HIVE-1350
>                 URL: https://issues.apache.org/jira/browse/HIVE-1350
>             Project: Hadoop Hive
>          Issue Type: Bug
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>         Attachments: hive.1350.1.patch
>
>
> if commands are executed by the same user within a second

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-1350) hive.query.id is not unique

Posted by "John Sichi (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12869323#action_12869323 ] 

John Sichi commented on HIVE-1350:
----------------------------------

+1.  Will commit if tests pass.


> hive.query.id is not unique 
> ----------------------------
>
>                 Key: HIVE-1350
>                 URL: https://issues.apache.org/jira/browse/HIVE-1350
>             Project: Hadoop Hive
>          Issue Type: Bug
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>         Attachments: hive.1350.1.patch, hive.1350.2.patch
>
>
> if commands are executed by the same user within a second

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-1350) hive.query.id is not unique

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12868947#action_12868947 ] 

Namit Jain commented on HIVE-1350:
----------------------------------

I am trying to do something simple.

For the audit logs generated inside facebook, I wont to log a unique queryId - so that different map-reduce jobs can be co-related.
I will switch to UUIDs, but it should not affect anything

> hive.query.id is not unique 
> ----------------------------
>
>                 Key: HIVE-1350
>                 URL: https://issues.apache.org/jira/browse/HIVE-1350
>             Project: Hadoop Hive
>          Issue Type: Bug
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>         Attachments: hive.1350.1.patch
>
>
> if commands are executed by the same user within a second

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-1350) hive.query.id is not unique

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach updated HIVE-1350:
---------------------------------

        Fix Version/s: 0.6.0
    Affects Version/s: 0.5.0
          Component/s: Query Processor

> hive.query.id is not unique 
> ----------------------------
>
>                 Key: HIVE-1350
>                 URL: https://issues.apache.org/jira/browse/HIVE-1350
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor
>    Affects Versions: 0.5.0
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>             Fix For: 0.6.0
>
>         Attachments: hive.1350.1.patch, hive.1350.2.patch
>
>
> if commands are executed by the same user within a second

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-1350) hive.query.id is not unique

Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12868926#action_12868926 ] 

Ning Zhang commented on HIVE-1350:
----------------------------------

It seems like this JIRA is partly duplicate what HIVE-1019 is trying to do. HIVE-1019 patch also uses UUID as the job ID to name the HIVE_PLAN file. But based on Zheng's comment, it will disable the resumability of failed jobs. 

Namit, can you take a look at the patch in HIVE-1019 particularly the newly added unit test and see if your patch passes?

> hive.query.id is not unique 
> ----------------------------
>
>                 Key: HIVE-1350
>                 URL: https://issues.apache.org/jira/browse/HIVE-1350
>             Project: Hadoop Hive
>          Issue Type: Bug
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>         Attachments: hive.1350.1.patch
>
>
> if commands are executed by the same user within a second

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-1350) hive.query.id is not unique

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain updated HIVE-1350:
-----------------------------

    Status: Patch Available  (was: Open)

> hive.query.id is not unique 
> ----------------------------
>
>                 Key: HIVE-1350
>                 URL: https://issues.apache.org/jira/browse/HIVE-1350
>             Project: Hadoop Hive
>          Issue Type: Bug
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>         Attachments: hive.1350.1.patch
>
>
> if commands are executed by the same user within a second

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.