[GitHub] [incubator-celeborn] mddxhj commented on pull request #1521: [CELEBORN-612][HELM] Tackle hostPath directory permission

["mddxhj (via GitHub)" <gi...@apache.org>]

mddxhj commented on PR #1521:
URL: https://github.com/apache/incubator-celeborn/pull/1521#issuecomment-1568390662

   it seems that it works indeed to set the ownership of  pod‘s /xxx/rss_ratis directory to celeborn:celeborn, but ownership of 
   sub-directory under /xxx/rss_ratis such as /xxx/rss_ratis/c5196f6d-2c34-3ed3-8b8a-47bede733167 is still not changed
   
   ![image](https://github.com/apache/incubator-celeborn/assets/29112453/8828bd7c-5384-46bc-b4fc-2cc9b7e6e0cc)
   
   and this will result in the following exception on celeborn master
   ```
   23/05/30 20:33:01,748 WARN [0-impl-thread1] RaftStorageDirectory: The storage directory /data/flink/celeborn/rss_ratis/c5196f6d-2c34-3ed3-8b8a-47bede733167 is not writable.
   Exception in thread "main" java.util.concurrent.CompletionException: java.io.IOException: Failed to load Storage Directory /data/flink/celeborn/rss_ratis/c5196f6d-2c34-3ed3-8b8a-47bede733167: NON_EXISTENT
   	at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292)
   	at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308)
   	at java.util.concurrent.CompletableFuture.biRelay(CompletableFuture.java:1298)
   	at java.util.concurrent.CompletableFuture$BiRelay.tryFire(CompletableFuture.java:1284)
   	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
   	at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990)
   	at org.apache.ratis.util.ConcurrentUtils.accept(ConcurrentUtils.java:191)
   	at org.apache.ratis.util.ConcurrentUtils.lambda$null$4(ConcurrentUtils.java:180)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:750)
   Caused by: java.io.IOException: Failed to load Storage Directory /data/flink/celeborn/rss_ratis/c5196f6d-2c34-3ed3-8b8a-47bede733167: NON_EXISTENT
   	at org.apache.ratis.server.storage.RaftStorageImpl.initialize(RaftStorageImpl.java:72)
   	at org.apache.ratis.server.impl.ServerState.initialize(ServerState.java:169)
   	at org.apache.ratis.server.impl.RaftServerImpl.start(RaftServerImpl.java:338)
   	at org.apache.ratis.util.ConcurrentUtils.accept(ConcurrentUtils.java:188)
   	... 4 more
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@celeborn.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org