You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Suresh Srinivas (JIRA)" <ji...@apache.org> on 2012/11/08 18:46:12 UTC

[jira] [Created] (HDFS-4166) Add support for scheduled automatic snapshots

Suresh Srinivas created HDFS-4166:
-------------------------------------

             Summary: Add support for scheduled automatic snapshots
                 Key: HDFS-4166
                 URL: https://issues.apache.org/jira/browse/HDFS-4166
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: name-node
    Affects Versions: Snapshot (HDFS-2802)
            Reporter: Suresh Srinivas
            Assignee: Suresh Srinivas


This jira will track the work related to supporting automatic scheduled snapshots. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4166) Add support for scheduled automatic snapshots

Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13493437#comment-13493437 ] 

Suresh Srinivas commented on HDFS-4166:
---------------------------------------

bq. What's the advantage of adding this to HDFS itself versus just automating snapshot creation via cron or some other periodic scheduling system? 
That is a good question. I am mulling over this as well, along the same lines as you. Perhaps we could discuss this in today's meetup.

The main reason why I am considering this is - you need to have a separate scheduling system, that needs to be highly available, then it needs to deal with non-availability of namenode etc. So a daemon thread along the lines of replication factor may be a simpler solution. But want to hear what others think.
                
> Add support for scheduled automatic snapshots
> ---------------------------------------------
>
>                 Key: HDFS-4166
>                 URL: https://issues.apache.org/jira/browse/HDFS-4166
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: name-node
>    Affects Versions: Snapshot (HDFS-2802)
>            Reporter: Suresh Srinivas
>            Assignee: Suresh Srinivas
>
> This jira will track the work related to supporting automatic scheduled snapshots. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4166) Add support for scheduled automatic snapshots

Posted by "Aaron T. Myers (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13493424#comment-13493424 ] 

Aaron T. Myers commented on HDFS-4166:
--------------------------------------

What's the advantage of adding this to HDFS itself versus just automating snapshot creation via cron or some other periodic scheduling system? (Honest question here, not suggesting it's necessarily a bad idea.)
                
> Add support for scheduled automatic snapshots
> ---------------------------------------------
>
>                 Key: HDFS-4166
>                 URL: https://issues.apache.org/jira/browse/HDFS-4166
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: name-node
>    Affects Versions: Snapshot (HDFS-2802)
>            Reporter: Suresh Srinivas
>            Assignee: Suresh Srinivas
>
> This jira will track the work related to supporting automatic scheduled snapshots. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (HDFS-4166) Add support for scheduled automatic snapshots

Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Suresh Srinivas resolved HDFS-4166.
-----------------------------------

    Resolution: Won't Fix

Closing this jira as won't fix per the meetup discussion.
                
> Add support for scheduled automatic snapshots
> ---------------------------------------------
>
>                 Key: HDFS-4166
>                 URL: https://issues.apache.org/jira/browse/HDFS-4166
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: name-node
>    Affects Versions: Snapshot (HDFS-2802)
>            Reporter: Suresh Srinivas
>            Assignee: Suresh Srinivas
>
> This jira will track the work related to supporting automatic scheduled snapshots. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4166) Add support for scheduled automatic snapshots

Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13494679#comment-13494679 ] 

Allen Wittenauer commented on HDFS-4166:
----------------------------------------

Discussion at the meeting was to nix this feature.
                
> Add support for scheduled automatic snapshots
> ---------------------------------------------
>
>                 Key: HDFS-4166
>                 URL: https://issues.apache.org/jira/browse/HDFS-4166
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: name-node
>    Affects Versions: Snapshot (HDFS-2802)
>            Reporter: Suresh Srinivas
>            Assignee: Suresh Srinivas
>
> This jira will track the work related to supporting automatic scheduled snapshots. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HDFS-4166) Add support for scheduled automatic snapshots

Posted by "Aaron T. Myers (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HDFS-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13493452#comment-13493452 ] 

Aaron T. Myers commented on HDFS-4166:
--------------------------------------

bq. The main reason why I am considering this is - you need to have a separate scheduling system, that needs to be highly available, then it needs to deal with non-availability of namenode etc

Good point. Perhaps Oozie, which already integrates tightly with Hadoop and I believe intends to add HA soon, would be the right way to do this?

bq. So a daemon thread along the lines of replication factor may be a simpler solution.

Yea, my main concern is that folks will want a rich scheduling interface (every week, every night, every X hours, every other Tuesday, etc.) that would be annoying for us to build into HDFS and already exists elsewhere.
                
> Add support for scheduled automatic snapshots
> ---------------------------------------------
>
>                 Key: HDFS-4166
>                 URL: https://issues.apache.org/jira/browse/HDFS-4166
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: name-node
>    Affects Versions: Snapshot (HDFS-2802)
>            Reporter: Suresh Srinivas
>            Assignee: Suresh Srinivas
>
> This jira will track the work related to supporting automatic scheduled snapshots. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira