You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@accumulo.apache.org by "John Vines (JIRA)" <ji...@apache.org> on 2012/05/04 21:28:48 UTC
[jira] [Created] (ACCUMULO-576) Extend TABLE_FAILURES_IGNORE to
major compactions
John Vines created ACCUMULO-576:
-----------------------------------
Summary: Extend TABLE_FAILURES_IGNORE to major compactions
Key: ACCUMULO-576
URL: https://issues.apache.org/jira/browse/ACCUMULO-576
Project: Accumulo
Issue Type: Improvement
Components: tserver
Affects Versions: 1.5.0, 1.4.0
Reporter: John Vines
Assignee: Keith Turner
We currently have TABLE_FAILURES_IGNORE which will silently ignore failures/hangs while scanning. We should look into extending this option for major compactions. The tricky part of this is that we don't want the files that we unread to be deleted, just ignored in the major compaction. This may not be feasible, but it's something worth looking into.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (ACCUMULO-576) Extend TABLE_FAILURES_IGNORE to
major compactions
Posted by "Christopher Tubbs (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/ACCUMULO-576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christopher Tubbs updated ACCUMULO-576:
---------------------------------------
Affects Version/s: 1.4.1
> Extend TABLE_FAILURES_IGNORE to major compactions
> -------------------------------------------------
>
> Key: ACCUMULO-576
> URL: https://issues.apache.org/jira/browse/ACCUMULO-576
> Project: Accumulo
> Issue Type: Improvement
> Components: tserver
> Affects Versions: 1.4.1, 1.4.0
> Reporter: John Vines
> Assignee: Keith Turner
> Fix For: 1.5.0
>
>
> We currently have TABLE_FAILURES_IGNORE which will silently ignore failures/hangs while scanning. We should look into extending this option for major compactions. The tricky part of this is that we don't want the files that we unread to be deleted, just ignored in the major compaction. This may not be feasible, but it's something worth looking into.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (ACCUMULO-576) Extend TABLE_FAILURES_IGNORE to
major compactions
Posted by "Keith Turner (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/ACCUMULO-576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13268662#comment-13268662 ]
Keith Turner commented on ACCUMULO-576:
---------------------------------------
One strategy could be to attempt the compaction, when a read failure occurs remove the offending file and restart the compaction. When the compaction finishes only remove the files that were successfully compacted.
> Extend TABLE_FAILURES_IGNORE to major compactions
> -------------------------------------------------
>
> Key: ACCUMULO-576
> URL: https://issues.apache.org/jira/browse/ACCUMULO-576
> Project: Accumulo
> Issue Type: Improvement
> Components: tserver
> Affects Versions: 1.5.0, 1.4.0
> Reporter: John Vines
> Assignee: Keith Turner
>
> We currently have TABLE_FAILURES_IGNORE which will silently ignore failures/hangs while scanning. We should look into extending this option for major compactions. The tricky part of this is that we don't want the files that we unread to be deleted, just ignored in the major compaction. This may not be feasible, but it's something worth looking into.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (ACCUMULO-576) Extend TABLE_FAILURES_IGNORE to
major compactions
Posted by "Christopher Tubbs (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/ACCUMULO-576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christopher Tubbs updated ACCUMULO-576:
---------------------------------------
Affects Version/s: (was: 1.5.0)
> Extend TABLE_FAILURES_IGNORE to major compactions
> -------------------------------------------------
>
> Key: ACCUMULO-576
> URL: https://issues.apache.org/jira/browse/ACCUMULO-576
> Project: Accumulo
> Issue Type: Improvement
> Components: tserver
> Affects Versions: 1.4.1, 1.4.0
> Reporter: John Vines
> Assignee: Keith Turner
> Fix For: 1.5.0
>
>
> We currently have TABLE_FAILURES_IGNORE which will silently ignore failures/hangs while scanning. We should look into extending this option for major compactions. The tricky part of this is that we don't want the files that we unread to be deleted, just ignored in the major compaction. This may not be feasible, but it's something worth looking into.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (ACCUMULO-576) Extend TABLE_FAILURES_IGNORE to
major compactions
Posted by "Christopher Tubbs (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/ACCUMULO-576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christopher Tubbs updated ACCUMULO-576:
---------------------------------------
Fix Version/s: 1.5.0
> Extend TABLE_FAILURES_IGNORE to major compactions
> -------------------------------------------------
>
> Key: ACCUMULO-576
> URL: https://issues.apache.org/jira/browse/ACCUMULO-576
> Project: Accumulo
> Issue Type: Improvement
> Components: tserver
> Affects Versions: 1.4.1, 1.4.0
> Reporter: John Vines
> Assignee: Keith Turner
> Fix For: 1.5.0
>
>
> We currently have TABLE_FAILURES_IGNORE which will silently ignore failures/hangs while scanning. We should look into extending this option for major compactions. The tricky part of this is that we don't want the files that we unread to be deleted, just ignored in the major compaction. This may not be feasible, but it's something worth looking into.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira