You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@chukwa.apache.org by "Jerome Boulon (JIRA)" <ji...@apache.org> on 2009/06/19 22:52:07 UTC
[jira] Created: (CHUKWA-318) Stop the collector if there's less
than XX% capacity
Stop the collector if there's less than XX% capacity
----------------------------------------------------
Key: CHUKWA-318
URL: https://issues.apache.org/jira/browse/CHUKWA-318
Project: Hadoop Chukwa
Issue Type: Bug
Reporter: Jerome Boulon
Assignee: Jerome Boulon
The localWriter is writting to the localFileSystem. The improvement is to add a protection on the available disk space.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-318) Stop the collector if there's less
than XX% capacity
Posted by "Jerome Boulon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12722015#action_12722015 ]
Jerome Boulon commented on CHUKWA-318:
--------------------------------------
Ideally you don't want to wait before pushing data. You already have a way to control how frequent you want to close the dataSink file so I assume if the rotate period is set to 5 minutes it's because you want to get what ever is available every 5 minutes, correct?
But the rotate function could be changed to close on another condition.
> Stop the collector if there's less than XX% capacity
> ----------------------------------------------------
>
> Key: CHUKWA-318
> URL: https://issues.apache.org/jira/browse/CHUKWA-318
> Project: Hadoop Chukwa
> Issue Type: Bug
> Reporter: Jerome Boulon
> Assignee: Jerome Boulon
>
> The localWriter is writting to the localFileSystem. The improvement is to add a protection on the available disk space.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Issue Comment Edited: (CHUKWA-318) Stop the collector if
there's less than XX% capacity
Posted by "Jerome Boulon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12722015#action_12722015 ]
Jerome Boulon edited comment on CHUKWA-318 at 6/19/09 2:17 PM:
---------------------------------------------------------------
Ideally you don't want to wait before pushing data. You already have a way to control how frequent you want to close the dataSink file so I assume if the rotate period is set to 5 minutes it's because you want to get what ever is available every 5 minutes, correct?
But the rotate function could be changed to close on another condition (rotate policy)
was (Author: jboulon):
Ideally you don't want to wait before pushing data. You already have a way to control how frequent you want to close the dataSink file so I assume if the rotate period is set to 5 minutes it's because you want to get what ever is available every 5 minutes, correct?
But the rotate function could be changed to close on another condition.
> Stop the collector if there's less than XX% capacity
> ----------------------------------------------------
>
> Key: CHUKWA-318
> URL: https://issues.apache.org/jira/browse/CHUKWA-318
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Reporter: Jerome Boulon
> Assignee: Jerome Boulon
>
> The localWriter is writting to the localFileSystem. The improvement is to add a protection on the available disk space.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-318) Stop the collector if there's less
than XX% capacity
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12723118#action_12723118 ]
Hudson commented on CHUKWA-318:
-------------------------------
Integrated in Chukwa-trunk #61 (See [http://hudson.zones.apache.org/hudson/job/Chukwa-trunk/61/])
> Stop the collector if there's less than XX% capacity
> ----------------------------------------------------
>
> Key: CHUKWA-318
> URL: https://issues.apache.org/jira/browse/CHUKWA-318
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: data collection
> Affects Versions: 0.2.0, 0.3.0
> Reporter: Jerome Boulon
> Assignee: Jerome Boulon
> Fix For: 0.2.0, 0.3.0
>
> Attachments: CHUKWA-318.patch
>
>
> The localWriter is writting to the localFileSystem. The improvement is to add a protection on the available disk space.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-318) Stop the collector if there's less
than XX% capacity
Posted by "Jerome Boulon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jerome Boulon updated CHUKWA-318:
---------------------------------
Component/s: data collection
> Stop the collector if there's less than XX% capacity
> ----------------------------------------------------
>
> Key: CHUKWA-318
> URL: https://issues.apache.org/jira/browse/CHUKWA-318
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: data collection
> Reporter: Jerome Boulon
> Assignee: Jerome Boulon
>
> The localWriter is writting to the localFileSystem. The improvement is to add a protection on the available disk space.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-318) Stop the collector if there's less
than XX% capacity
Posted by "Jerome Boulon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jerome Boulon updated CHUKWA-318:
---------------------------------
Fix Version/s: 0.3.0
0.2.0
Affects Version/s: 0.3.0
0.2.0
Status: Patch Available (was: Open)
> Stop the collector if there's less than XX% capacity
> ----------------------------------------------------
>
> Key: CHUKWA-318
> URL: https://issues.apache.org/jira/browse/CHUKWA-318
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: data collection
> Affects Versions: 0.2.0, 0.3.0
> Reporter: Jerome Boulon
> Assignee: Jerome Boulon
> Fix For: 0.2.0, 0.3.0
>
> Attachments: CHUKWA-318.patch
>
>
> The localWriter is writting to the localFileSystem. The improvement is to add a protection on the available disk space.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-318) Stop the collector if there's less
than XX% capacity
Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12722004#action_12722004 ]
Ari Rabkin commented on CHUKWA-318:
-----------------------------------
It should also be possible to specify a policy "push data once there's X megabytes accumulated."
> Stop the collector if there's less than XX% capacity
> ----------------------------------------------------
>
> Key: CHUKWA-318
> URL: https://issues.apache.org/jira/browse/CHUKWA-318
> Project: Hadoop Chukwa
> Issue Type: Bug
> Reporter: Jerome Boulon
> Assignee: Jerome Boulon
>
> The localWriter is writting to the localFileSystem. The improvement is to add a protection on the available disk space.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-318) Stop the collector if there's less
than XX% capacity
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12722090#action_12722090 ]
Eric Yang commented on CHUKWA-318:
----------------------------------
+1 looks good.
> Stop the collector if there's less than XX% capacity
> ----------------------------------------------------
>
> Key: CHUKWA-318
> URL: https://issues.apache.org/jira/browse/CHUKWA-318
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: data collection
> Affects Versions: 0.2.0, 0.3.0
> Reporter: Jerome Boulon
> Assignee: Jerome Boulon
> Fix For: 0.2.0, 0.3.0
>
> Attachments: CHUKWA-318.patch
>
>
> The localWriter is writting to the localFileSystem. The improvement is to add a protection on the available disk space.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-318) Stop the collector if there's less
than XX% capacity
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-318:
-----------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I just committed this, thanks Jerome.
> Stop the collector if there's less than XX% capacity
> ----------------------------------------------------
>
> Key: CHUKWA-318
> URL: https://issues.apache.org/jira/browse/CHUKWA-318
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: data collection
> Affects Versions: 0.2.0, 0.3.0
> Reporter: Jerome Boulon
> Assignee: Jerome Boulon
> Fix For: 0.2.0, 0.3.0
>
> Attachments: CHUKWA-318.patch
>
>
> The localWriter is writting to the localFileSystem. The improvement is to add a protection on the available disk space.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-318) Stop the collector if there's less
than XX% capacity
Posted by "Jerome Boulon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jerome Boulon updated CHUKWA-318:
---------------------------------
Issue Type: Improvement (was: Bug)
> Stop the collector if there's less than XX% capacity
> ----------------------------------------------------
>
> Key: CHUKWA-318
> URL: https://issues.apache.org/jira/browse/CHUKWA-318
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Reporter: Jerome Boulon
> Assignee: Jerome Boulon
>
> The localWriter is writting to the localFileSystem. The improvement is to add a protection on the available disk space.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-318) Stop the collector if there's less
than XX% capacity
Posted by "Jerome Boulon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jerome Boulon updated CHUKWA-318:
---------------------------------
Attachment: CHUKWA-318.patch
Check for disk space while rotating
> Stop the collector if there's less than XX% capacity
> ----------------------------------------------------
>
> Key: CHUKWA-318
> URL: https://issues.apache.org/jira/browse/CHUKWA-318
> Project: Hadoop Chukwa
> Issue Type: Improvement
> Components: data collection
> Affects Versions: 0.2.0, 0.3.0
> Reporter: Jerome Boulon
> Assignee: Jerome Boulon
> Fix For: 0.2.0, 0.3.0
>
> Attachments: CHUKWA-318.patch
>
>
> The localWriter is writting to the localFileSystem. The improvement is to add a protection on the available disk space.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.