You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "He Yongqiang (JIRA)" <ji...@apache.org> on 2011/03/30 02:54:05 UTC

[jira] [Created] (HIVE-2083) Bug: RowContainer was set to 1 in JoinUtils.

Bug: RowContainer was set to 1 in JoinUtils.
--------------------------------------------

                 Key: HIVE-2083
                 URL: https://issues.apache.org/jira/browse/HIVE-2083
             Project: Hive
          Issue Type: Bug
            Reporter: He Yongqiang
            Assignee: He Yongqiang




--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-2083) Bug: RowContainer was set to 1 in JoinUtils.

Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach updated HIVE-2083:
---------------------------------

      Component/s: Query Processor
    Fix Version/s: 0.8.0

> Bug: RowContainer was set to 1 in JoinUtils.
> --------------------------------------------
>
>                 Key: HIVE-2083
>                 URL: https://issues.apache.org/jira/browse/HIVE-2083
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: He Yongqiang
>            Assignee: He Yongqiang
>             Fix For: 0.8.0
>
>         Attachments: HIVE-2083.1.patch
>
>
> This cause the skew join super slow because the row container dump every record to disk before using them.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2083) Bug: RowContainer was set to 1 in JoinUtils.

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13012799#comment-13012799 ] 

Namit Jain commented on HIVE-2083:
----------------------------------

+1

> Bug: RowContainer was set to 1 in JoinUtils.
> --------------------------------------------
>
>                 Key: HIVE-2083
>                 URL: https://issues.apache.org/jira/browse/HIVE-2083
>             Project: Hive
>          Issue Type: Bug
>            Reporter: He Yongqiang
>            Assignee: He Yongqiang
>         Attachments: HIVE-2083.1.patch
>
>
> This cause the skew join super slow because the row container dump every record to disk before using them.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-2083) Bug: RowContainer was set to 1 in JoinUtils.

Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

He Yongqiang updated HIVE-2083:
-------------------------------

    Description: This cause the skew join super slow because the row container dump every record to disk before using them.

> Bug: RowContainer was set to 1 in JoinUtils.
> --------------------------------------------
>
>                 Key: HIVE-2083
>                 URL: https://issues.apache.org/jira/browse/HIVE-2083
>             Project: Hive
>          Issue Type: Bug
>            Reporter: He Yongqiang
>            Assignee: He Yongqiang
>
> This cause the skew join super slow because the row container dump every record to disk before using them.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-2083) Bug: RowContainer was set to 1 in JoinUtils.

Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

He Yongqiang updated HIVE-2083:
-------------------------------

    Attachment: HIVE-2083.1.patch

> Bug: RowContainer was set to 1 in JoinUtils.
> --------------------------------------------
>
>                 Key: HIVE-2083
>                 URL: https://issues.apache.org/jira/browse/HIVE-2083
>             Project: Hive
>          Issue Type: Bug
>            Reporter: He Yongqiang
>            Assignee: He Yongqiang
>         Attachments: HIVE-2083.1.patch
>
>
> This cause the skew join super slow because the row container dump every record to disk before using them.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-2083) Bug: RowContainer was set to 1 in JoinUtils.

Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

He Yongqiang updated HIVE-2083:
-------------------------------

    Status: Patch Available  (was: Open)

> Bug: RowContainer was set to 1 in JoinUtils.
> --------------------------------------------
>
>                 Key: HIVE-2083
>                 URL: https://issues.apache.org/jira/browse/HIVE-2083
>             Project: Hive
>          Issue Type: Bug
>            Reporter: He Yongqiang
>            Assignee: He Yongqiang
>         Attachments: HIVE-2083.1.patch
>
>
> This cause the skew join super slow because the row container dump every record to disk before using them.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HIVE-2083) Bug: RowContainer was set to 1 in JoinUtils.

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain updated HIVE-2083:
-----------------------------

      Resolution: Fixed
    Hadoop Flags: [Reviewed]
          Status: Resolved  (was: Patch Available)

Committed. Thanks Yongqiang

> Bug: RowContainer was set to 1 in JoinUtils.
> --------------------------------------------
>
>                 Key: HIVE-2083
>                 URL: https://issues.apache.org/jira/browse/HIVE-2083
>             Project: Hive
>          Issue Type: Bug
>            Reporter: He Yongqiang
>            Assignee: He Yongqiang
>         Attachments: HIVE-2083.1.patch
>
>
> This cause the skew join super slow because the row container dump every record to disk before using them.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-2083) Bug: RowContainer was set to 1 in JoinUtils.

Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13012797#comment-13012797 ] 

He Yongqiang commented on HIVE-2083:
------------------------------------

And also in our internal env, the FS.listStatus can return NULL instead of zero length array. Added a fix for this also.

> Bug: RowContainer was set to 1 in JoinUtils.
> --------------------------------------------
>
>                 Key: HIVE-2083
>                 URL: https://issues.apache.org/jira/browse/HIVE-2083
>             Project: Hive
>          Issue Type: Bug
>            Reporter: He Yongqiang
>            Assignee: He Yongqiang
>         Attachments: HIVE-2083.1.patch
>
>
> This cause the skew join super slow because the row container dump every record to disk before using them.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira