You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@accumulo.apache.org by "Dave Marion (Created) (JIRA)" <ji...@apache.org> on 2012/01/25 21:42:45 UTC
[jira] [Created] (ACCUMULO-348) Adding splits to table via the
shell with addsplits is very slow when adding a lot of split points
Adding splits to table via the shell with addsplits is very slow when adding a lot of split points
--------------------------------------------------------------------------------------------------
Key: ACCUMULO-348
URL: https://issues.apache.org/jira/browse/ACCUMULO-348
Project: Accumulo
Issue Type: Improvement
Affects Versions: 1.3.5
Reporter: Dave Marion
Priority: Minor
Fix For: 1.5.0
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (ACCUMULO-348) Adding splits to table via the
shell with addsplits is very slow when adding a lot of split points
Posted by "Billie Rinaldi (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/ACCUMULO-348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199752#comment-13199752 ]
Billie Rinaldi commented on ACCUMULO-348:
-----------------------------------------
Could we batch the splits to tablet servers instead of sending them individually?
> Adding splits to table via the shell with addsplits is very slow when adding a lot of split points
> --------------------------------------------------------------------------------------------------
>
> Key: ACCUMULO-348
> URL: https://issues.apache.org/jira/browse/ACCUMULO-348
> Project: Accumulo
> Issue Type: Improvement
> Affects Versions: 1.3.5
> Reporter: Dave Marion
> Priority: Minor
> Fix For: 1.5.0
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (ACCUMULO-348) Adding splits to table via the
shell with addsplits is very slow when adding a lot of split points
Posted by "Keith Turner (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/ACCUMULO-348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199777#comment-13199777 ]
Keith Turner commented on ACCUMULO-348:
---------------------------------------
Could have parallelism at the tablet server and client level. If the tablet server gets a batch of splits it can work on them in parallel. The client can send split messages to multiple tablet servers at the same time.
> Adding splits to table via the shell with addsplits is very slow when adding a lot of split points
> --------------------------------------------------------------------------------------------------
>
> Key: ACCUMULO-348
> URL: https://issues.apache.org/jira/browse/ACCUMULO-348
> Project: Accumulo
> Issue Type: Improvement
> Affects Versions: 1.3.5
> Reporter: Dave Marion
> Priority: Minor
> Fix For: 1.5.0
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (ACCUMULO-348) Adding splits to table via the
shell with addsplits is very slow when adding a lot of split points
Posted by "Keith Turner (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/ACCUMULO-348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13199775#comment-13199775 ]
Keith Turner commented on ACCUMULO-348:
---------------------------------------
Batching would help along with building in the parallelism.
> Adding splits to table via the shell with addsplits is very slow when adding a lot of split points
> --------------------------------------------------------------------------------------------------
>
> Key: ACCUMULO-348
> URL: https://issues.apache.org/jira/browse/ACCUMULO-348
> Project: Accumulo
> Issue Type: Improvement
> Affects Versions: 1.3.5
> Reporter: Dave Marion
> Priority: Minor
> Fix For: 1.5.0
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (ACCUMULO-348) Adding splits to table via the
shell with addsplits is very slow when adding a lot of split points
Posted by "Keith Turner (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/ACCUMULO-348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13193317#comment-13193317 ]
Keith Turner commented on ACCUMULO-348:
---------------------------------------
One work around may be to spin up multiple clients adding splits in parallel. I think it would be best if the clients had no overlapping sets of split points. Based on how the code works, I suspect this will be a lot faster. However I have not tested this.
> Adding splits to table via the shell with addsplits is very slow when adding a lot of split points
> --------------------------------------------------------------------------------------------------
>
> Key: ACCUMULO-348
> URL: https://issues.apache.org/jira/browse/ACCUMULO-348
> Project: Accumulo
> Issue Type: Improvement
> Affects Versions: 1.3.5
> Reporter: Dave Marion
> Priority: Minor
> Fix For: 1.5.0
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira