You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Vinod K V (JIRA)" <ji...@apache.org> on 2009/03/06 12:41:56 UTC
[jira] Created: (HADOOP-5425) JVM reuse across task types
JVM reuse across task types
---------------------------
Key: HADOOP-5425
URL: https://issues.apache.org/jira/browse/HADOOP-5425
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Reporter: Vinod K V
Currently, JVM-reuse is across tasks of same type of the same job, i.e. JVMs are kind of marked as map-JVMs and reduce JVMs. May be we can reuse JVMs across tasks of different types but of the same job.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5425) JVM reuse across task types
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj Das updated HADOOP-5425:
--------------------------------
Status: Open (was: Patch Available)
Vinod pointed out that we cannot reuse the same jvm across multiple task types at least for the reason that one might want to specify different heap sizes for the map and reduce jvms.
> JVM reuse across task types
> ---------------------------
>
> Key: HADOOP-5425
> URL: https://issues.apache.org/jira/browse/HADOOP-5425
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Devaraj Das
> Fix For: 0.21.0
>
> Attachments: 5425.1.patch
>
>
> Currently, JVM-reuse is across tasks of same type of the same job, i.e. JVMs are kind of marked as map-JVMs and reduce JVMs. May be we can reuse JVMs across tasks of different types but of the same job.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5425) JVM reuse across task types
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj Das updated HADOOP-5425:
--------------------------------
Attachment: 5425.1.patch
Straightforward patch. The patch removes the JvmManager's internal class JvmManagerForType and all the methods defined there are now accessible via JvmManager. The patch looks big mainly because of indentation changes.
> JVM reuse across task types
> ---------------------------
>
> Key: HADOOP-5425
> URL: https://issues.apache.org/jira/browse/HADOOP-5425
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Vinod K V
> Attachments: 5425.1.patch
>
>
> Currently, JVM-reuse is across tasks of same type of the same job, i.e. JVMs are kind of marked as map-JVMs and reduce JVMs. May be we can reuse JVMs across tasks of different types but of the same job.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5425) JVM reuse across task types
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj Das updated HADOOP-5425:
--------------------------------
Status: Patch Available (was: Open)
> JVM reuse across task types
> ---------------------------
>
> Key: HADOOP-5425
> URL: https://issues.apache.org/jira/browse/HADOOP-5425
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Devaraj Das
> Fix For: 0.21.0
>
> Attachments: 5425.1.patch
>
>
> Currently, JVM-reuse is across tasks of same type of the same job, i.e. JVMs are kind of marked as map-JVMs and reduce JVMs. May be we can reuse JVMs across tasks of different types but of the same job.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5425) JVM reuse across task types
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj Das updated HADOOP-5425:
--------------------------------
Affects Version/s: 0.19.0
Fix Version/s: 0.21.0
Assignee: Devaraj Das
> JVM reuse across task types
> ---------------------------
>
> Key: HADOOP-5425
> URL: https://issues.apache.org/jira/browse/HADOOP-5425
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Vinod K V
> Assignee: Devaraj Das
> Fix For: 0.21.0
>
> Attachments: 5425.1.patch
>
>
> Currently, JVM-reuse is across tasks of same type of the same job, i.e. JVMs are kind of marked as map-JVMs and reduce JVMs. May be we can reuse JVMs across tasks of different types but of the same job.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.