You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Namit Jain (JIRA)" <ji...@apache.org> on 2009/06/27 01:27:47 UTC

[jira] Created: (HIVE-585) mapjoin may lead to timeouts

mapjoin may lead to timeouts
----------------------------

                 Key: HIVE-585
                 URL: https://issues.apache.org/jira/browse/HIVE-585
             Project: Hadoop Hive
          Issue Type: Bug
          Components: Query Processor
    Affects Versions: 0.4.0
            Reporter: Namit Jain


MapJoin reads the entire mapper-side tables before emitting any output. 
This causes timeouts - 

I can employ similar approach to Script - any other suggestions !!!


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-585) mapjoin may lead to timeouts

Posted by "Ashish Thusoo (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12724787#action_12724787 ] 

Ashish Thusoo commented on HIVE-585:
------------------------------------

Write to stderr and use that as a proxy to send progress messages to the jobtracker.


> mapjoin may lead to timeouts
> ----------------------------
>
>                 Key: HIVE-585
>                 URL: https://issues.apache.org/jira/browse/HIVE-585
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor
>    Affects Versions: 0.4.0
>            Reporter: Namit Jain
>
> MapJoin reads the entire mapper-side tables before emitting any output. 
> This causes timeouts - 
> I can employ similar approach to Script - any other suggestions !!!

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-585) mapjoin may lead to timeouts

Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12724782#action_12724782 ] 

Zheng Shao commented on HIVE-585:
---------------------------------

What is the current timeout? Is it 10 minutes?

> mapjoin may lead to timeouts
> ----------------------------
>
>                 Key: HIVE-585
>                 URL: https://issues.apache.org/jira/browse/HIVE-585
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor
>    Affects Versions: 0.4.0
>            Reporter: Namit Jain
>
> MapJoin reads the entire mapper-side tables before emitting any output. 
> This causes timeouts - 
> I can employ similar approach to Script - any other suggestions !!!

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HIVE-585) mapjoin may lead to timeouts

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain resolved HIVE-585.
-----------------------------

    Resolution: Duplicate

duplicate of 530

> mapjoin may lead to timeouts
> ----------------------------
>
>                 Key: HIVE-585
>                 URL: https://issues.apache.org/jira/browse/HIVE-585
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor
>    Affects Versions: 0.4.0
>            Reporter: Namit Jain
>
> MapJoin reads the entire mapper-side tables before emitting any output. 
> This causes timeouts - 
> I can employ similar approach to Script - any other suggestions !!!

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.