You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Bennie Schut (JIRA)" <ji...@apache.org> on 2010/12/10 11:24:04 UTC

[jira] Commented: (HIVE-1846) change hive assumption that local mode mappers/reducers always run in same jvm

    [ https://issues.apache.org/jira/browse/HIVE-1846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12970118#action_12970118 ] 

Bennie Schut commented on HIVE-1846:
------------------------------------

One of the problems I ran into on local mode was a missing plan. If this is solved perhaps it also solves part of HIVE-1675.

> change hive assumption that local mode mappers/reducers always run in same jvm 
> -------------------------------------------------------------------------------
>
>                 Key: HIVE-1846
>                 URL: https://issues.apache.org/jira/browse/HIVE-1846
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Joydeep Sen Sarma
>            Assignee: Joydeep Sen Sarma
>         Attachments: HIVE-1846.patch
>
>
> we are trying out a version of hadoop local mode that runs multiple mappers/reducers by spawning jvm's for them. In this mode hive mappers fail in reading the plan file. it seems that we assume (in the setMapredWork call) that local mode mappers/reducers will run in the same jvm (we can cache the current plan in a global var and don't serialize to a path). this needs to get fixed.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.