You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@accumulo.apache.org by GitBox <gi...@apache.org> on 2021/06/24 16:08:53 UTC
[GitHub] [accumulo] milleruntime edited a comment on issue #2179: Handle old sorted map files
milleruntime edited a comment on issue #2179:
URL: https://github.com/apache/accumulo/issues/2179#issuecomment-867763969
I tested an upgrade in Uno with some data and sorted WAL files. I was surprised to not see any errors trying to recover the old map files. I noticed that the GC deleted the files rather quickly after the Upgrader was finished.
<pre>
11:04:24 {main} ~/workspace/uno$ hdfs dfs -ls -R /accumulo/recovery
drwxr-xr-x - mike supergroup 0 2021-06-24 11:04 /accumulo/recovery/980ce402-07dc-4a09-b6ac-e26664db29a3
drwxr-xr-x - mike supergroup 0 2021-06-24 11:04 /accumulo/recovery/980ce402-07dc-4a09-b6ac-e26664db29a3/part-r-00000
-rw-r--r-- 3 mike supergroup 366452 2021-06-24 11:04 /accumulo/recovery/980ce402-07dc-4a09-b6ac-e26664db29a3/part-r-00000/data
-rw-r--r-- 3 mike supergroup 255 2021-06-24 11:04 /accumulo/recovery/980ce402-07dc-4a09-b6ac-e26664db29a3/part-r-00000/index
drwxr-xr-x - mike supergroup 0 2021-06-24 11:04 /accumulo/recovery/980ce402-07dc-4a09-b6ac-e26664db29a3/part-r-00001
-rw-r--r-- 3 mike supergroup 366592 2021-06-24 11:04 /accumulo/recovery/980ce402-07dc-4a09-b6ac-e26664db29a3/part-r-00001/data
-rw-r--r-- 3 mike supergroup 224 2021-06-24 11:04 /accumulo/recovery/980ce402-07dc-4a09-b6ac-e26664db29a3/part-r-00001/index
drwxr-xr-x - mike supergroup 0 2021-06-24 11:04 /accumulo/recovery/980ce402-07dc-4a09-b6ac-e26664db29a3/part-r-00002
-rw-r--r-- 3 mike supergroup 366727 2021-06-24 11:04 /accumulo/recovery/980ce402-07dc-4a09-b6ac-e26664db29a3/part-r-00002/data
-rw-r--r-- 3 mike supergroup 224 2021-06-24 11:04 /accumulo/recovery/980ce402-07dc-4a09-b6ac-e26664db29a3/part-r-00002/index
11:49:32 {main} ~/workspace/uno/install/logs/accumulo$ grep 980ce402-07dc-4a09-b6ac-e26664db29a3 *
gc_ip-10-113-12-25.log:2021-06-24T11:08:05,957 [gc.GarbageCollectWriteAheadLogs] DEBUG: Removing CLOSED WAL hdfs://localhost:8020/accumulo/wal/ip-10-113-12-25+9997/980ce402-07dc-4a09-b6ac-e26664db29a3
gc_ip-10-113-12-25.log:2021-06-24T11:08:05,965 [gc.GarbageCollectWriteAheadLogs] DEBUG: Removing recovery log hdfs://localhost:8020/accumulo/recovery/980ce402-07dc-4a09-b6ac-e26664db29a3
gc_ip-10-113-12-25.log:2021-06-24T11:08:05,979 [log.WalStateManager] DEBUG: Removing 980ce402-07dc-4a09-b6ac-e26664db29a3
</pre>
I am going to try the test again but use CI to make sure there wasn't data any data loss.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org