You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Suresh Srinivas (JIRA)" <ji...@apache.org> on 2012/11/08 18:46:12 UTC
[jira] [Created] (HDFS-4166) Add support for scheduled automatic
snapshots
Suresh Srinivas created HDFS-4166:
-------------------------------------
Summary: Add support for scheduled automatic snapshots
Key: HDFS-4166
URL: https://issues.apache.org/jira/browse/HDFS-4166
Project: Hadoop HDFS
Issue Type: Sub-task
Components: name-node
Affects Versions: Snapshot (HDFS-2802)
Reporter: Suresh Srinivas
Assignee: Suresh Srinivas
This jira will track the work related to supporting automatic scheduled snapshots.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4166) Add support for scheduled automatic
snapshots
Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13493437#comment-13493437 ]
Suresh Srinivas commented on HDFS-4166:
---------------------------------------
bq. What's the advantage of adding this to HDFS itself versus just automating snapshot creation via cron or some other periodic scheduling system?
That is a good question. I am mulling over this as well, along the same lines as you. Perhaps we could discuss this in today's meetup.
The main reason why I am considering this is - you need to have a separate scheduling system, that needs to be highly available, then it needs to deal with non-availability of namenode etc. So a daemon thread along the lines of replication factor may be a simpler solution. But want to hear what others think.
> Add support for scheduled automatic snapshots
> ---------------------------------------------
>
> Key: HDFS-4166
> URL: https://issues.apache.org/jira/browse/HDFS-4166
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: name-node
> Affects Versions: Snapshot (HDFS-2802)
> Reporter: Suresh Srinivas
> Assignee: Suresh Srinivas
>
> This jira will track the work related to supporting automatic scheduled snapshots.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4166) Add support for scheduled automatic
snapshots
Posted by "Aaron T. Myers (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13493424#comment-13493424 ]
Aaron T. Myers commented on HDFS-4166:
--------------------------------------
What's the advantage of adding this to HDFS itself versus just automating snapshot creation via cron or some other periodic scheduling system? (Honest question here, not suggesting it's necessarily a bad idea.)
> Add support for scheduled automatic snapshots
> ---------------------------------------------
>
> Key: HDFS-4166
> URL: https://issues.apache.org/jira/browse/HDFS-4166
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: name-node
> Affects Versions: Snapshot (HDFS-2802)
> Reporter: Suresh Srinivas
> Assignee: Suresh Srinivas
>
> This jira will track the work related to supporting automatic scheduled snapshots.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HDFS-4166) Add support for scheduled automatic
snapshots
Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suresh Srinivas resolved HDFS-4166.
-----------------------------------
Resolution: Won't Fix
Closing this jira as won't fix per the meetup discussion.
> Add support for scheduled automatic snapshots
> ---------------------------------------------
>
> Key: HDFS-4166
> URL: https://issues.apache.org/jira/browse/HDFS-4166
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: name-node
> Affects Versions: Snapshot (HDFS-2802)
> Reporter: Suresh Srinivas
> Assignee: Suresh Srinivas
>
> This jira will track the work related to supporting automatic scheduled snapshots.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4166) Add support for scheduled automatic
snapshots
Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13494679#comment-13494679 ]
Allen Wittenauer commented on HDFS-4166:
----------------------------------------
Discussion at the meeting was to nix this feature.
> Add support for scheduled automatic snapshots
> ---------------------------------------------
>
> Key: HDFS-4166
> URL: https://issues.apache.org/jira/browse/HDFS-4166
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: name-node
> Affects Versions: Snapshot (HDFS-2802)
> Reporter: Suresh Srinivas
> Assignee: Suresh Srinivas
>
> This jira will track the work related to supporting automatic scheduled snapshots.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-4166) Add support for scheduled automatic
snapshots
Posted by "Aaron T. Myers (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13493452#comment-13493452 ]
Aaron T. Myers commented on HDFS-4166:
--------------------------------------
bq. The main reason why I am considering this is - you need to have a separate scheduling system, that needs to be highly available, then it needs to deal with non-availability of namenode etc
Good point. Perhaps Oozie, which already integrates tightly with Hadoop and I believe intends to add HA soon, would be the right way to do this?
bq. So a daemon thread along the lines of replication factor may be a simpler solution.
Yea, my main concern is that folks will want a rich scheduling interface (every week, every night, every X hours, every other Tuesday, etc.) that would be annoying for us to build into HDFS and already exists elsewhere.
> Add support for scheduled automatic snapshots
> ---------------------------------------------
>
> Key: HDFS-4166
> URL: https://issues.apache.org/jira/browse/HDFS-4166
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: name-node
> Affects Versions: Snapshot (HDFS-2802)
> Reporter: Suresh Srinivas
> Assignee: Suresh Srinivas
>
> This jira will track the work related to supporting automatic scheduled snapshots.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira