You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@accumulo.apache.org by "keith-turner (via GitHub)" <gi...@apache.org> on 2023/03/20 23:44:23 UTC
[GitHub] [accumulo] keith-turner opened a new pull request, #3249: Avoids holding tablet lock while doing split computations
keith-turner opened a new pull request, #3249:
URL: https://github.com/apache/accumulo/pull/3249
In addition to avoiding tablet lock for split computations, this PR also avoid redoing split computations when the files have not changed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo] keith-turner commented on pull request #3249: Avoids holding tablet lock while doing split computations
Posted by "keith-turner (via GitHub)" <gi...@apache.org>.
keith-turner commented on PR #3249:
URL: https://github.com/apache/accumulo/pull/3249#issuecomment-1477771066
Realized this change could possibly lead to split starvation. The change allows more concurrency would means if the split takes a long time to compute and files keep coming in that the tablet may never split because its always recomputing the split point. I think maybe this can be avoided with a simple change which I will work on shortly.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo] ctubbsii commented on a diff in pull request #3249: Avoids holding tablet lock while doing split computations
Posted by "ctubbsii (via GitHub)" <gi...@apache.org>.
ctubbsii commented on code in PR #3249:
URL: https://github.com/apache/accumulo/pull/3249#discussion_r1150972807
##########
server/tserver/src/main/java/org/apache/accumulo/tserver/tablet/Tablet.java:
##########
@@ -1664,85 +1670,75 @@ private SplitRowSpec findSplitRow(Collection<FileRef> files) {
}
// check to see if one row takes up most of the tablet, in which case we can not split
- try {
-
- Text lastRow;
- if (extent.getEndRow() == null) {
- Key lastKey = (Key) FileUtil.findLastKey(getTabletServer().getFileSystem(),
- getTabletServer().getConfiguration(), files);
- lastRow = lastKey.getRow();
- } else {
- lastRow = extent.getEndRow();
- }
-
- // We expect to get a midPoint for this set of files. If we don't get one, we have a problem.
- final Key mid = keys.get(.5);
- if (mid == null) {
- throw new IllegalStateException("Could not determine midpoint for files on " + extent);
- }
+ Text lastRow;
+ if (extent.getEndRow() == null) {
+ lastRow = splitComputations.get().lastRowForDefaultTablet;
+ } else {
+ lastRow = extent.getEndRow();
+ }
- // check to see that the midPoint is not equal to the end key
- if (mid.compareRow(lastRow) == 0) {
- if (keys.firstKey() < .5) {
- Key candidate = keys.get(keys.firstKey());
- if (candidate.getLength() > maxEndRow) {
- log.warn("Cannot split tablet " + extent
- + ", selected split point too long. Length : " + candidate.getLength());
+ // We expect to get a midPoint for this set of files. If we don't get one, we have a problem.
+ final Key mid = keys.get(.5);
+ if (mid == null) {
+ throw new IllegalStateException("Could not determine midpoint for files on " + extent);
+ }
- sawBigRow = true;
- timeOfLastMinCWhenBigFreakinRowWasSeen = lastMinorCompactionFinishTime;
- timeOfLastImportWhenBigFreakinRowWasSeen = lastMapFileImportTime;
+ // check to see that the midPoint is not equal to the end key
+ if (mid.compareRow(lastRow) == 0) {
+ if (keys.firstKey() < .5) {
+ Key candidate = keys.get(keys.firstKey());
+ if (candidate.getLength() > maxEndRow) {
+ log.warn("Cannot split tablet " + extent + ", selected split point too long. Length : "
+ + candidate.getLength());
- return null;
- }
- if (candidate.compareRow(lastRow) != 0) {
- // we should use this ratio in split size estimations
- if (log.isTraceEnabled())
- log.trace(
- String.format("Splitting at %6.2f instead of .5, row at .5 is same as end row%n",
- keys.firstKey()));
- return new SplitRowSpec(keys.firstKey(), candidate.getRow());
- }
+ sawBigRow = true;
+ timeOfLastMinCWhenBigFreakinRowWasSeen = lastMinorCompactionFinishTime;
+ timeOfLastImportWhenBigFreakinRowWasSeen = lastMapFileImportTime;
+ return null;
+ }
+ if (candidate.compareRow(lastRow) != 0) {
+ // we should use this ratio in split size estimations
+ if (log.isTraceEnabled())
+ log.trace(
+ String.format("Splitting at %6.2f instead of .5, row at .5 is same as end row%n",
+ keys.firstKey()));
+ return new SplitRowSpec(keys.firstKey(), candidate.getRow());
}
- log.warn("Cannot split tablet " + extent + " it contains a big row : " + lastRow);
+ }
- sawBigRow = true;
- timeOfLastMinCWhenBigFreakinRowWasSeen = lastMinorCompactionFinishTime;
- timeOfLastImportWhenBigFreakinRowWasSeen = lastMapFileImportTime;
+ log.warn("Cannot split tablet " + extent + " it contains a big row : " + lastRow);
Review Comment:
As long as it's updated during the merge to 2.1, I don't mind 1.10 not being fixed. We spent a lot of time updating these in 2.0, so we don't want to regress on the merge.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo] dlmarion commented on a diff in pull request #3249: Avoids holding tablet lock while doing split computations
Posted by "dlmarion (via GitHub)" <gi...@apache.org>.
dlmarion commented on code in PR #3249:
URL: https://github.com/apache/accumulo/pull/3249#discussion_r1145055092
##########
server/tserver/src/main/java/org/apache/accumulo/tserver/tablet/Tablet.java:
##########
@@ -1664,85 +1670,75 @@ private SplitRowSpec findSplitRow(Collection<FileRef> files) {
}
// check to see if one row takes up most of the tablet, in which case we can not split
- try {
-
- Text lastRow;
- if (extent.getEndRow() == null) {
- Key lastKey = (Key) FileUtil.findLastKey(getTabletServer().getFileSystem(),
- getTabletServer().getConfiguration(), files);
- lastRow = lastKey.getRow();
- } else {
- lastRow = extent.getEndRow();
- }
-
- // We expect to get a midPoint for this set of files. If we don't get one, we have a problem.
- final Key mid = keys.get(.5);
- if (mid == null) {
- throw new IllegalStateException("Could not determine midpoint for files on " + extent);
- }
+ Text lastRow;
+ if (extent.getEndRow() == null) {
+ lastRow = splitComputations.get().lastRowForDefaultTablet;
+ } else {
+ lastRow = extent.getEndRow();
+ }
- // check to see that the midPoint is not equal to the end key
- if (mid.compareRow(lastRow) == 0) {
- if (keys.firstKey() < .5) {
- Key candidate = keys.get(keys.firstKey());
- if (candidate.getLength() > maxEndRow) {
- log.warn("Cannot split tablet " + extent
- + ", selected split point too long. Length : " + candidate.getLength());
+ // We expect to get a midPoint for this set of files. If we don't get one, we have a problem.
+ final Key mid = keys.get(.5);
+ if (mid == null) {
+ throw new IllegalStateException("Could not determine midpoint for files on " + extent);
+ }
- sawBigRow = true;
- timeOfLastMinCWhenBigFreakinRowWasSeen = lastMinorCompactionFinishTime;
- timeOfLastImportWhenBigFreakinRowWasSeen = lastMapFileImportTime;
+ // check to see that the midPoint is not equal to the end key
+ if (mid.compareRow(lastRow) == 0) {
+ if (keys.firstKey() < .5) {
+ Key candidate = keys.get(keys.firstKey());
+ if (candidate.getLength() > maxEndRow) {
+ log.warn("Cannot split tablet " + extent + ", selected split point too long. Length : "
+ + candidate.getLength());
- return null;
- }
- if (candidate.compareRow(lastRow) != 0) {
- // we should use this ratio in split size estimations
- if (log.isTraceEnabled())
- log.trace(
- String.format("Splitting at %6.2f instead of .5, row at .5 is same as end row%n",
- keys.firstKey()));
- return new SplitRowSpec(keys.firstKey(), candidate.getRow());
- }
+ sawBigRow = true;
+ timeOfLastMinCWhenBigFreakinRowWasSeen = lastMinorCompactionFinishTime;
+ timeOfLastImportWhenBigFreakinRowWasSeen = lastMapFileImportTime;
+ return null;
+ }
+ if (candidate.compareRow(lastRow) != 0) {
+ // we should use this ratio in split size estimations
+ if (log.isTraceEnabled())
+ log.trace(
+ String.format("Splitting at %6.2f instead of .5, row at .5 is same as end row%n",
+ keys.firstKey()));
+ return new SplitRowSpec(keys.firstKey(), candidate.getRow());
}
- log.warn("Cannot split tablet " + extent + " it contains a big row : " + lastRow);
+ }
- sawBigRow = true;
- timeOfLastMinCWhenBigFreakinRowWasSeen = lastMinorCompactionFinishTime;
- timeOfLastImportWhenBigFreakinRowWasSeen = lastMapFileImportTime;
+ log.warn("Cannot split tablet " + extent + " it contains a big row : " + lastRow);
Review Comment:
should we use logging placeholders ("{}") here? Given that it's at the warn level, I'm not sure it makes a difference. Just a thought.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo] keith-turner commented on pull request #3249: Avoids holding tablet lock while doing split computations
Posted by "keith-turner (via GitHub)" <gi...@apache.org>.
keith-turner commented on PR #3249:
URL: https://github.com/apache/accumulo/pull/3249#issuecomment-1477102514
Ran all ITs matching the pattern `*Split*IT` and that looked good.
```
INFO] -------------------------------------------------------
[INFO] T E S T S
[INFO] -------------------------------------------------------
[INFO] Running org.apache.accumulo.test.LargeSplitRowIT
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.505 s - in org.apache.accumulo.test.LargeSplitRowIT
[INFO] Running org.apache.accumulo.test.functional.BatchScanSplitIT
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.504 s - in org.apache.accumulo.test.functional.BatchScanSplitIT
[INFO] Running org.apache.accumulo.test.functional.SplitRecoveryIT
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.354 s - in org.apache.accumulo.test.functional.SplitRecoveryIT
[INFO] Running org.apache.accumulo.test.functional.AddSplitIT
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.51 s - in org.apache.accumulo.test.functional.AddSplitIT
[INFO] Running org.apache.accumulo.test.functional.DeleteTableDuringSplitIT
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 67.48 s - in org.apache.accumulo.test.functional.DeleteTableDuringSplitIT
[INFO] Running org.apache.accumulo.test.functional.DeleteRowsSplitIT
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 42.34 s - in org.apache.accumulo.test.functional.DeleteRowsSplitIT
[INFO] Running org.apache.accumulo.test.functional.BulkSplitOptimizationIT
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.016 s - in org.apache.accumulo.test.functional.BulkSplitOptimizationIT
[INFO] Running org.apache.accumulo.test.functional.MetadataSplitIT
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.841 s - in org.apache.accumulo.test.functional.MetadataSplitIT
[INFO] Running org.apache.accumulo.test.functional.SplitIT
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 92.578 s - in org.apache.accumulo.test.functional.SplitIT
[INFO] Running org.apache.accumulo.test.SplitRecoveryIT
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.61 s - in org.apache.accumulo.test.SplitRecoveryIT
[INFO] Running org.apache.accumulo.test.ManySplitIT
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.312 s - in org.apache.accumulo.test.ManySplitIT
[INFO] Running org.apache.accumulo.test.SplitCancelsMajCIT
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 68.982 s - in org.apache.accumulo.test.SplitCancelsMajCIT
[INFO] Running org.apache.accumulo.test.MetaSplitIT
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.511 s - in org.apache.accumulo.test.MetaSplitIT
[INFO]
[INFO] Results:
[INFO]
[INFO] Tests run: 21, Failures: 0, Errors: 0, Skipped: 0
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo] keith-turner commented on pull request #3249: Avoids holding tablet lock while doing split computations
Posted by "keith-turner (via GitHub)" <gi...@apache.org>.
keith-turner commented on PR #3249:
URL: https://github.com/apache/accumulo/pull/3249#issuecomment-1477093649
Ignoring white space changes makes the diffs smaller.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo] ctubbsii commented on a diff in pull request #3249: Avoids holding tablet lock while doing split computations
Posted by "ctubbsii (via GitHub)" <gi...@apache.org>.
ctubbsii commented on code in PR #3249:
URL: https://github.com/apache/accumulo/pull/3249#discussion_r1146983348
##########
server/tserver/src/main/java/org/apache/accumulo/tserver/tablet/Tablet.java:
##########
@@ -1664,85 +1670,75 @@ private SplitRowSpec findSplitRow(Collection<FileRef> files) {
}
// check to see if one row takes up most of the tablet, in which case we can not split
- try {
-
- Text lastRow;
- if (extent.getEndRow() == null) {
- Key lastKey = (Key) FileUtil.findLastKey(getTabletServer().getFileSystem(),
- getTabletServer().getConfiguration(), files);
- lastRow = lastKey.getRow();
- } else {
- lastRow = extent.getEndRow();
- }
-
- // We expect to get a midPoint for this set of files. If we don't get one, we have a problem.
- final Key mid = keys.get(.5);
- if (mid == null) {
- throw new IllegalStateException("Could not determine midpoint for files on " + extent);
- }
+ Text lastRow;
+ if (extent.getEndRow() == null) {
+ lastRow = splitComputations.get().lastRowForDefaultTablet;
+ } else {
+ lastRow = extent.getEndRow();
+ }
- // check to see that the midPoint is not equal to the end key
- if (mid.compareRow(lastRow) == 0) {
- if (keys.firstKey() < .5) {
- Key candidate = keys.get(keys.firstKey());
- if (candidate.getLength() > maxEndRow) {
- log.warn("Cannot split tablet " + extent
- + ", selected split point too long. Length : " + candidate.getLength());
+ // We expect to get a midPoint for this set of files. If we don't get one, we have a problem.
+ final Key mid = keys.get(.5);
+ if (mid == null) {
+ throw new IllegalStateException("Could not determine midpoint for files on " + extent);
+ }
- sawBigRow = true;
- timeOfLastMinCWhenBigFreakinRowWasSeen = lastMinorCompactionFinishTime;
- timeOfLastImportWhenBigFreakinRowWasSeen = lastMapFileImportTime;
+ // check to see that the midPoint is not equal to the end key
+ if (mid.compareRow(lastRow) == 0) {
+ if (keys.firstKey() < .5) {
+ Key candidate = keys.get(keys.firstKey());
+ if (candidate.getLength() > maxEndRow) {
+ log.warn("Cannot split tablet " + extent + ", selected split point too long. Length : "
+ + candidate.getLength());
- return null;
- }
- if (candidate.compareRow(lastRow) != 0) {
- // we should use this ratio in split size estimations
- if (log.isTraceEnabled())
- log.trace(
- String.format("Splitting at %6.2f instead of .5, row at .5 is same as end row%n",
- keys.firstKey()));
- return new SplitRowSpec(keys.firstKey(), candidate.getRow());
- }
+ sawBigRow = true;
+ timeOfLastMinCWhenBigFreakinRowWasSeen = lastMinorCompactionFinishTime;
+ timeOfLastImportWhenBigFreakinRowWasSeen = lastMapFileImportTime;
+ return null;
+ }
+ if (candidate.compareRow(lastRow) != 0) {
+ // we should use this ratio in split size estimations
+ if (log.isTraceEnabled())
+ log.trace(
+ String.format("Splitting at %6.2f instead of .5, row at .5 is same as end row%n",
+ keys.firstKey()));
+ return new SplitRowSpec(keys.firstKey(), candidate.getRow());
}
- log.warn("Cannot split tablet " + extent + " it contains a big row : " + lastRow);
+ }
- sawBigRow = true;
- timeOfLastMinCWhenBigFreakinRowWasSeen = lastMinorCompactionFinishTime;
- timeOfLastImportWhenBigFreakinRowWasSeen = lastMapFileImportTime;
+ log.warn("Cannot split tablet " + extent + " it contains a big row : " + lastRow);
Review Comment:
Definitely should use placeholders whenever possible, for safety. You never know what's going to get logged and incorrectly parsed as part of the format string. We took efforts in 2.0 to fix a bunch of those, and we should try to fix it whenever we see them going forward.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo] keith-turner merged pull request #3249: Avoids holding tablet lock while doing split computations
Posted by "keith-turner (via GitHub)" <gi...@apache.org>.
keith-turner merged PR #3249:
URL: https://github.com/apache/accumulo/pull/3249
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo] keith-turner commented on pull request #3249: Avoids holding tablet lock while doing split computations
Posted by "keith-turner (via GitHub)" <gi...@apache.org>.
keith-turner commented on PR #3249:
URL: https://github.com/apache/accumulo/pull/3249#issuecomment-1478583266
Removed the check that could cause split starvation in 2a7aac6 and reran the `*Split*IT` tests and all passed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo] keith-turner commented on a diff in pull request #3249: Avoids holding tablet lock while doing split computations
Posted by "keith-turner (via GitHub)" <gi...@apache.org>.
keith-turner commented on code in PR #3249:
URL: https://github.com/apache/accumulo/pull/3249#discussion_r1148113852
##########
server/tserver/src/main/java/org/apache/accumulo/tserver/tablet/Tablet.java:
##########
@@ -1664,85 +1670,75 @@ private SplitRowSpec findSplitRow(Collection<FileRef> files) {
}
// check to see if one row takes up most of the tablet, in which case we can not split
- try {
-
- Text lastRow;
- if (extent.getEndRow() == null) {
- Key lastKey = (Key) FileUtil.findLastKey(getTabletServer().getFileSystem(),
- getTabletServer().getConfiguration(), files);
- lastRow = lastKey.getRow();
- } else {
- lastRow = extent.getEndRow();
- }
-
- // We expect to get a midPoint for this set of files. If we don't get one, we have a problem.
- final Key mid = keys.get(.5);
- if (mid == null) {
- throw new IllegalStateException("Could not determine midpoint for files on " + extent);
- }
+ Text lastRow;
+ if (extent.getEndRow() == null) {
+ lastRow = splitComputations.get().lastRowForDefaultTablet;
+ } else {
+ lastRow = extent.getEndRow();
+ }
- // check to see that the midPoint is not equal to the end key
- if (mid.compareRow(lastRow) == 0) {
- if (keys.firstKey() < .5) {
- Key candidate = keys.get(keys.firstKey());
- if (candidate.getLength() > maxEndRow) {
- log.warn("Cannot split tablet " + extent
- + ", selected split point too long. Length : " + candidate.getLength());
+ // We expect to get a midPoint for this set of files. If we don't get one, we have a problem.
+ final Key mid = keys.get(.5);
+ if (mid == null) {
+ throw new IllegalStateException("Could not determine midpoint for files on " + extent);
+ }
- sawBigRow = true;
- timeOfLastMinCWhenBigFreakinRowWasSeen = lastMinorCompactionFinishTime;
- timeOfLastImportWhenBigFreakinRowWasSeen = lastMapFileImportTime;
+ // check to see that the midPoint is not equal to the end key
+ if (mid.compareRow(lastRow) == 0) {
+ if (keys.firstKey() < .5) {
+ Key candidate = keys.get(keys.firstKey());
+ if (candidate.getLength() > maxEndRow) {
+ log.warn("Cannot split tablet " + extent + ", selected split point too long. Length : "
+ + candidate.getLength());
- return null;
- }
- if (candidate.compareRow(lastRow) != 0) {
- // we should use this ratio in split size estimations
- if (log.isTraceEnabled())
- log.trace(
- String.format("Splitting at %6.2f instead of .5, row at .5 is same as end row%n",
- keys.firstKey()));
- return new SplitRowSpec(keys.firstKey(), candidate.getRow());
- }
+ sawBigRow = true;
+ timeOfLastMinCWhenBigFreakinRowWasSeen = lastMinorCompactionFinishTime;
+ timeOfLastImportWhenBigFreakinRowWasSeen = lastMapFileImportTime;
+ return null;
+ }
+ if (candidate.compareRow(lastRow) != 0) {
+ // we should use this ratio in split size estimations
+ if (log.isTraceEnabled())
+ log.trace(
+ String.format("Splitting at %6.2f instead of .5, row at .5 is same as end row%n",
+ keys.firstKey()));
+ return new SplitRowSpec(keys.firstKey(), candidate.getRow());
}
- log.warn("Cannot split tablet " + extent + " it contains a big row : " + lastRow);
+ }
- sawBigRow = true;
- timeOfLastMinCWhenBigFreakinRowWasSeen = lastMinorCompactionFinishTime;
- timeOfLastImportWhenBigFreakinRowWasSeen = lastMapFileImportTime;
+ log.warn("Cannot split tablet " + extent + " it contains a big row : " + lastRow);
Review Comment:
Gave this a try and it did not work. Looked into why and it seems the Tablet class is using log4j directly for logging and not slf4j. The lack of `{}` is a widespread issue in this class so I am not going to address that in this PR. Hopefully things are better when I merge forward to 2.1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org