You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Hairong Kuang (JIRA)" <ji...@apache.org> on 2007/06/29 01:43:04 UTC
[jira] Created: (HADOOP-1545) Maps hang when using native
compression library to compress map out
Maps hang when using native compression library to compress map out
-------------------------------------------------------------------
Key: HADOOP-1545
URL: https://issues.apache.org/jira/browse/HADOOP-1545
Project: Hadoop
Issue Type: Bug
Components: mapred
Affects Versions: 0.13.0
Reporter: Hairong Kuang
Fix For: 0.14.0
This issue is related to HADOOP-1193. I ran the same job. Each map of this job spawns a process which generates output to be cosumed by the map. The new native compression librar seems to hang some of the spawned processes. Some processes print using more than 100% CPU. Non-native library does not produce this problem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1545) Maps hang when using native
compression library to compress map out
Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12530280 ]
Milind Bhandarkar commented on HADOOP-1545:
-------------------------------------------
Do we know the causes for this now ?
> Maps hang when using native compression library to compress map out
> -------------------------------------------------------------------
>
> Key: HADOOP-1545
> URL: https://issues.apache.org/jira/browse/HADOOP-1545
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.13.0
> Reporter: Hairong Kuang
> Assignee: Arun C Murthy
> Priority: Critical
> Fix For: 0.15.0
>
>
> This issue is related to HADOOP-1193. I ran the same job. Each map of this job spawns a process which generates output to be cosumed by the map. The new native compression librar seems to hang some of the spawned processes. Some processes print using more than 100% CPU. Non-native library does not produce this problem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1545) Maps hang when using native
compression library to compress map out
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12514302 ]
Arun C Murthy commented on HADOOP-1545:
---------------------------------------
Hairong, after the investigations we have done into this and lack of closure on causes for this particular job's failure do you think it makes sense to move this bug to 0.15 and hence mark it as a non-blocker for now? Thanks!
> Maps hang when using native compression library to compress map out
> -------------------------------------------------------------------
>
> Key: HADOOP-1545
> URL: https://issues.apache.org/jira/browse/HADOOP-1545
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.13.0
> Reporter: Hairong Kuang
> Assignee: Arun C Murthy
> Priority: Blocker
> Fix For: 0.14.0
>
>
> This issue is related to HADOOP-1193. I ran the same job. Each map of this job spawns a process which generates output to be cosumed by the map. The new native compression librar seems to hang some of the spawned processes. Some processes print using more than 100% CPU. Non-native library does not produce this problem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-1545) Maps hang when using native
compression library to compress map out
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur reassigned HADOOP-1545:
----------------------------------------
Assignee: Arun C Murthy (was: dhruba borthakur)
> Maps hang when using native compression library to compress map out
> -------------------------------------------------------------------
>
> Key: HADOOP-1545
> URL: https://issues.apache.org/jira/browse/HADOOP-1545
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.13.0
> Reporter: Hairong Kuang
> Assignee: Arun C Murthy
> Priority: Critical
> Fix For: 0.15.0
>
>
> This issue is related to HADOOP-1193. I ran the same job. Each map of this job spawns a process which generates output to be cosumed by the map. The new native compression librar seems to hang some of the spawned processes. Some processes print using more than 100% CPU. Non-native library does not produce this problem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1545) Maps hang when using native
compression library to compress map out
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated HADOOP-1545:
----------------------------------
Fix Version/s: (was: 0.14.0)
0.15.0
Priority: Critical (was: Blocker)
Thanks Hairong, I'm marking this *critical* for 0.15.0
> Maps hang when using native compression library to compress map out
> -------------------------------------------------------------------
>
> Key: HADOOP-1545
> URL: https://issues.apache.org/jira/browse/HADOOP-1545
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.13.0
> Reporter: Hairong Kuang
> Assignee: Arun C Murthy
> Priority: Critical
> Fix For: 0.15.0
>
>
> This issue is related to HADOOP-1193. I ran the same job. Each map of this job spawns a process which generates output to be cosumed by the map. The new native compression librar seems to hang some of the spawned processes. Some processes print using more than 100% CPU. Non-native library does not produce this problem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-1545) Maps hang when using native
compression library to compress map out
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur reassigned HADOOP-1545:
----------------------------------------
Assignee: dhruba borthakur (was: Arun C Murthy)
> Maps hang when using native compression library to compress map out
> -------------------------------------------------------------------
>
> Key: HADOOP-1545
> URL: https://issues.apache.org/jira/browse/HADOOP-1545
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.13.0
> Reporter: Hairong Kuang
> Assignee: dhruba borthakur
> Priority: Critical
> Fix For: 0.15.0
>
>
> This issue is related to HADOOP-1193. I ran the same job. Each map of this job spawns a process which generates output to be cosumed by the map. The new native compression librar seems to hang some of the spawned processes. Some processes print using more than 100% CPU. Non-native library does not produce this problem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1545) Maps hang when using native
compression library to compress map out
Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12514303 ]
Hairong Kuang commented on HADOOP-1545:
---------------------------------------
+1
> Maps hang when using native compression library to compress map out
> -------------------------------------------------------------------
>
> Key: HADOOP-1545
> URL: https://issues.apache.org/jira/browse/HADOOP-1545
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.13.0
> Reporter: Hairong Kuang
> Assignee: Arun C Murthy
> Priority: Blocker
> Fix For: 0.15.0
>
>
> This issue is related to HADOOP-1193. I ran the same job. Each map of this job spawns a process which generates output to be cosumed by the map. The new native compression librar seems to hang some of the spawned processes. Some processes print using more than 100% CPU. Non-native library does not produce this problem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1545) Maps hang when using native
compression library to compress map out
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nigel Daley updated HADOOP-1545:
--------------------------------
Priority: Blocker (was: Major)
> Maps hang when using native compression library to compress map out
> -------------------------------------------------------------------
>
> Key: HADOOP-1545
> URL: https://issues.apache.org/jira/browse/HADOOP-1545
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.13.0
> Reporter: Hairong Kuang
> Priority: Blocker
> Fix For: 0.14.0
>
>
> This issue is related to HADOOP-1193. I ran the same job. Each map of this job spawns a process which generates output to be cosumed by the map. The new native compression librar seems to hang some of the spawned processes. Some processes print using more than 100% CPU. Non-native library does not produce this problem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-1545) Maps hang when using native
compression library to compress map out
Posted by "Sameer Paranjpye (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sameer Paranjpye reassigned HADOOP-1545:
----------------------------------------
Assignee: Arun C Murthy
> Maps hang when using native compression library to compress map out
> -------------------------------------------------------------------
>
> Key: HADOOP-1545
> URL: https://issues.apache.org/jira/browse/HADOOP-1545
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.13.0
> Reporter: Hairong Kuang
> Assignee: Arun C Murthy
> Priority: Blocker
> Fix For: 0.14.0
>
>
> This issue is related to HADOOP-1193. I ran the same job. Each map of this job spawns a process which generates output to be cosumed by the map. The new native compression librar seems to hang some of the spawned processes. Some processes print using more than 100% CPU. Non-native library does not produce this problem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HADOOP-1545) Maps hang when using native
compression library to compress map out
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy resolved HADOOP-1545.
-----------------------------------
Resolution: Invalid
The last we checked there were a couple of application-level issues... I'm closing this for now. Please feel free to re-open or file a new jira.
> Maps hang when using native compression library to compress map out
> -------------------------------------------------------------------
>
> Key: HADOOP-1545
> URL: https://issues.apache.org/jira/browse/HADOOP-1545
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.13.0
> Reporter: Hairong Kuang
> Assignee: Arun C Murthy
> Priority: Critical
> Fix For: 0.15.0
>
>
> This issue is related to HADOOP-1193. I ran the same job. Each map of this job spawns a process which generates output to be cosumed by the map. The new native compression librar seems to hang some of the spawned processes. Some processes print using more than 100% CPU. Non-native library does not produce this problem.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.