You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@chukwa.apache.org by "Kirk True (JIRA)" <ji...@apache.org> on 2010/07/28 23:56:16 UTC

[jira] Created: (CHUKWA-504) Implement ability to delete file in FileAdaptor after successfully uploaded

Implement ability to delete file in FileAdaptor after successfully uploaded
---------------------------------------------------------------------------

                 Key: CHUKWA-504
                 URL: https://issues.apache.org/jira/browse/CHUKWA-504
             Project: Chukwa
          Issue Type: New Feature
          Components: data collection
    Affects Versions: 0.4.0
            Reporter: Kirk True
            Priority: Minor
         Attachments: FileAdaptor.patch

My client's use case is to feed lots of little data files into the Chukwa system. They're collected first by a web API, saved to disk, and then a locally-running agent is notified with the path to the file name.

Naturally, there's an issue of wasting disk space by keeping all the files around on the web nodes unnecessarily. So a simple addition of an optional "delete" parameter when adding a FileAdaptor appears to do the trick.

Forthcoming is a patch against 0.4.0 that we used to achieve this. The parameter is optional in order to maintain compatibility.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (CHUKWA-504) Implement ability to delete file in FileAdaptor after successfully uploaded

Posted by "Kirk True (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CHUKWA-504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kirk True updated CHUKWA-504:
-----------------------------

    Attachment: FileAdaptor.patch

Here's a patch to the FileAdaptor to delete the file after upload.

> Implement ability to delete file in FileAdaptor after successfully uploaded
> ---------------------------------------------------------------------------
>
>                 Key: CHUKWA-504
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-504
>             Project: Chukwa
>          Issue Type: New Feature
>          Components: data collection
>    Affects Versions: 0.4.0
>            Reporter: Kirk True
>            Priority: Minor
>         Attachments: FileAdaptor.patch
>
>
> My client's use case is to feed lots of little data files into the Chukwa system. They're collected first by a web API, saved to disk, and then a locally-running agent is notified with the path to the file name.
> Naturally, there's an issue of wasting disk space by keeping all the files around on the web nodes unnecessarily. So a simple addition of an optional "delete" parameter when adding a FileAdaptor appears to do the trick.
> Forthcoming is a patch against 0.4.0 that we used to achieve this. The parameter is optional in order to maintain compatibility.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Work started: (CHUKWA-504) Implement ability to delete file in FileAdaptor after successfully uploaded

Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CHUKWA-504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Work on CHUKWA-504 started by Ari Rabkin.

> Implement ability to delete file in FileAdaptor after successfully uploaded
> ---------------------------------------------------------------------------
>
>                 Key: CHUKWA-504
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-504
>             Project: Chukwa
>          Issue Type: New Feature
>          Components: data collection
>    Affects Versions: 0.4.0
>            Reporter: Kirk True
>            Assignee: Ari Rabkin
>            Priority: Minor
>         Attachments: FileAdaptor.patch
>
>
> My client's use case is to feed lots of little data files into the Chukwa system. They're collected first by a web API, saved to disk, and then a locally-running agent is notified with the path to the file name.
> Naturally, there's an issue of wasting disk space by keeping all the files around on the web nodes unnecessarily. So a simple addition of an optional "delete" parameter when adding a FileAdaptor appears to do the trick.
> Forthcoming is a patch against 0.4.0 that we used to achieve this. The parameter is optional in order to maintain compatibility.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (CHUKWA-504) Implement ability to delete file in FileAdaptor after successfully uploaded

Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CHUKWA-504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12894088#action_12894088 ] 

Ari Rabkin commented on CHUKWA-504:
-----------------------------------

I just committed the patch.  Thanks, Kirk.

Marking issue as in progress because I want to remind myself to fix the documentation to reflect this change.

> Implement ability to delete file in FileAdaptor after successfully uploaded
> ---------------------------------------------------------------------------
>
>                 Key: CHUKWA-504
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-504
>             Project: Chukwa
>          Issue Type: New Feature
>          Components: data collection
>    Affects Versions: 0.4.0
>            Reporter: Kirk True
>            Assignee: Ari Rabkin
>            Priority: Minor
>         Attachments: FileAdaptor.patch
>
>
> My client's use case is to feed lots of little data files into the Chukwa system. They're collected first by a web API, saved to disk, and then a locally-running agent is notified with the path to the file name.
> Naturally, there's an issue of wasting disk space by keeping all the files around on the web nodes unnecessarily. So a simple addition of an optional "delete" parameter when adding a FileAdaptor appears to do the trick.
> Forthcoming is a patch against 0.4.0 that we used to achieve this. The parameter is optional in order to maintain compatibility.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Assigned: (CHUKWA-504) Implement ability to delete file in FileAdaptor after successfully uploaded

Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CHUKWA-504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ari Rabkin reassigned CHUKWA-504:
---------------------------------

    Assignee: Ari Rabkin

> Implement ability to delete file in FileAdaptor after successfully uploaded
> ---------------------------------------------------------------------------
>
>                 Key: CHUKWA-504
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-504
>             Project: Chukwa
>          Issue Type: New Feature
>          Components: data collection
>    Affects Versions: 0.4.0
>            Reporter: Kirk True
>            Assignee: Ari Rabkin
>            Priority: Minor
>         Attachments: FileAdaptor.patch
>
>
> My client's use case is to feed lots of little data files into the Chukwa system. They're collected first by a web API, saved to disk, and then a locally-running agent is notified with the path to the file name.
> Naturally, there's an issue of wasting disk space by keeping all the files around on the web nodes unnecessarily. So a simple addition of an optional "delete" parameter when adding a FileAdaptor appears to do the trick.
> Forthcoming is a patch against 0.4.0 that we used to achieve this. The parameter is optional in order to maintain compatibility.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.