You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by wheatdog liou <wh...@gmail.com> on 2021/02/19 02:47:31 UTC
java.io.IOException: Could not create storage directory for BLOB
store in '/tmp'
Hi, I am new to Flink and was following Flink with docker-compose
<https://ci.apache.org/projects/flink/flink-docs-stable/deployment/resource-providers/standalone/docker.html#flink-with-docker-compose>
and
encounter this error. I used the session-cluster docker-compose.yml
template from the document:
version: "2.2"
services:
jobmanager:
image: flink:1.12.0-scala_2.11
ports:
- "8081:8081"
command: jobmanager
environment:
- |
FLINK_PROPERTIES=
jobmanager.rpc.address: jobmanager
taskmanager:
image: flink:1.12.0-scala_2.11
depends_on:
- jobmanager
command: taskmanager
scale: 1
environment:
- |
FLINK_PROPERTIES=
jobmanager.rpc.address: jobmanager
taskmanager.numberOfTaskSlots: 2
jobmanager and taskmanager both got the same error at initialization:
taskmanager_1 | 2021-02-19 02:30:36,940 INFO
org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting
RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService
at
akka://flink-metrics/user/MetricQueryService_35cd708df0ef5a7b90ed8839b105eaa5
.
taskmanager_1 | 2021-02-19 02:30:36,978 ERROR
org.apache.flink.runtime.taskexecutor.TaskManagerRunner - TaskManager
initialization failed.
taskmanager_1 | java.io.IOException: Could not create storage directory
for BLOB store in '/tmp'.
taskmanager_1 | at
org.apache.flink.runtime.blob.BlobUtils.initLocalStorageDirectory(BlobUtils.java:154)
taskmanager_1 | at
org.apache.flink.runtime.blob.AbstractBlobCache.<init>(AbstractBlobCache.java:106)
taskmanager_1 | at
org.apache.flink.runtime.blob.PermanentBlobCache.<init>(PermanentBlobCache.java:104)
taskmanager_1 | at
org.apache.flink.runtime.blob.BlobCacheService.<init>(BlobCacheService.java:58)
taskmanager_1 | at
org.apache.flink.runtime.taskexecutor.TaskManagerRunner.<init>(TaskManagerRunner.java:153)
taskmanager_1 | at
org.apache.flink.runtime.taskexecutor.TaskManagerRunner.runTaskManager(TaskManagerRunner.java:327)
taskmanager_1 | at
org.apache.flink.runtime.taskexecutor.TaskManagerRunner.lambda$runTaskManagerSecurely$3(TaskManagerRunner.java:351)
taskmanager_1 | at
org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
taskmanager_1 | at
org.apache.flink.runtime.taskexecutor.TaskManagerRunner.runTaskManagerSecurely(TaskManagerRunner.java:350)
taskmanager_1 | at
org.apache.flink.runtime.taskexecutor.TaskManagerRunner.runTaskManagerSecurely(TaskManagerRunner.java:335)
taskmanager_1 | at
org.apache.flink.runtime.taskexecutor.TaskManagerRunner.main(TaskManagerRunner.java:306)
jobmanager_1 | 2021-02-19 02:30:25,739 ERROR
org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Could not
start cluster entrypoint StandaloneSessionClusterEntrypoint.
jobmanager_1 |
org.apache.flink.runtime.entrypoint.ClusterEntrypointException: Failed to
initialize the cluster entrypoint StandaloneSessionClusterEntrypoint.
jobmanager_1 | at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:189)
jobmanager_1 | at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runClusterEntrypoint(ClusterEntrypoint.java:520)
jobmanager_1 | at
org.apache.flink.runtime.entrypoint.StandaloneSessionClusterEntrypoint.main(StandaloneSessionClusterEntrypoint.java:64)
jobmanager_1 | Caused by: java.io.IOException: Could not create storage
directory for BLOB store in '/tmp'.
jobmanager_1 | at
org.apache.flink.runtime.blob.BlobUtils.initLocalStorageDirectory(BlobUtils.java:154)
jobmanager_1 | at
org.apache.flink.runtime.blob.BlobServer.<init>(BlobServer.java:140)
jobmanager_1 | at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.initializeServices(ClusterEntrypoint.java:266)
jobmanager_1 | at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:209)
jobmanager_1 | at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$0(ClusterEntrypoint.java:171)
jobmanager_1 | at
org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
jobmanager_1 | at
org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:170)
jobmanager_1 | ... 2 more
Any idea how I can solve it? Thanks!
Re: java.io.IOException: Could not create storage directory for BLOB
store in '/tmp'
Posted by wheatdog liou <wh...@gmail.com>.
Turns out the disk used by docker for mac is full. I followed the operation
on docker site [1] and everything is fine.
[1]
https://docs.docker.com/docker-for-mac/space/#delete-unnecessary-containers-and-images
wheatdog liou <wh...@gmail.com> 於 2021年2月19日 週五 上午10:47寫道：
> Hi, I am new to Flink and was following Flink with docker-compose
> <https://ci.apache.org/projects/flink/flink-docs-stable/deployment/resource-providers/standalone/docker.html#flink-with-docker-compose> and
> encounter this error. I used the session-cluster docker-compose.yml
> template from the document:
>
> version: "2.2"
> services:
>
> jobmanager:
>
> image: flink:1.12.0-scala_2.11
>
> ports:
>
> - "8081:8081"
>
> command: jobmanager
>
> environment:
>
> - |
>
> FLINK_PROPERTIES=
>
> jobmanager.rpc.address: jobmanager
>
>
>
> taskmanager:
>
> image: flink:1.12.0-scala_2.11
>
> depends_on:
>
> - jobmanager
>
> command: taskmanager
>
> scale: 1
>
> environment:
>
> - |
>
> FLINK_PROPERTIES=
>
> jobmanager.rpc.address: jobmanager
>
> taskmanager.numberOfTaskSlots: 2
>
> jobmanager and taskmanager both got the same error at initialization:
>
> taskmanager_1 | 2021-02-19 02:30:36,940 INFO
> org.apache.flink.runtime.rpc.akka.AkkaRpcService - Starting
> RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService
> at
> akka://flink-metrics/user/MetricQueryService_35cd708df0ef5a7b90ed8839b105eaa5
> .
> taskmanager_1 | 2021-02-19 02:30:36,978 ERROR
> org.apache.flink.runtime.taskexecutor.TaskManagerRunner - TaskManager
> initialization failed.
> taskmanager_1 | java.io.IOException: Could not create storage directory
> for BLOB store in '/tmp'.
> taskmanager_1 | at
> org.apache.flink.runtime.blob.BlobUtils.initLocalStorageDirectory(BlobUtils.java:154)
> taskmanager_1 | at
> org.apache.flink.runtime.blob.AbstractBlobCache.<init>(AbstractBlobCache.java:106)
> taskmanager_1 | at
> org.apache.flink.runtime.blob.PermanentBlobCache.<init>(PermanentBlobCache.java:104)
> taskmanager_1 | at
> org.apache.flink.runtime.blob.BlobCacheService.<init>(BlobCacheService.java:58)
> taskmanager_1 | at
> org.apache.flink.runtime.taskexecutor.TaskManagerRunner.<init>(TaskManagerRunner.java:153)
> taskmanager_1 | at
> org.apache.flink.runtime.taskexecutor.TaskManagerRunner.runTaskManager(TaskManagerRunner.java:327)
> taskmanager_1 | at
> org.apache.flink.runtime.taskexecutor.TaskManagerRunner.lambda$runTaskManagerSecurely$3(TaskManagerRunner.java:351)
> taskmanager_1 | at
> org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
> taskmanager_1 | at
> org.apache.flink.runtime.taskexecutor.TaskManagerRunner.runTaskManagerSecurely(TaskManagerRunner.java:350)
> taskmanager_1 | at
> org.apache.flink.runtime.taskexecutor.TaskManagerRunner.runTaskManagerSecurely(TaskManagerRunner.java:335)
> taskmanager_1 | at
> org.apache.flink.runtime.taskexecutor.TaskManagerRunner.main(TaskManagerRunner.java:306)
>
> jobmanager_1 | 2021-02-19 02:30:25,739 ERROR
> org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Could not
> start cluster entrypoint StandaloneSessionClusterEntrypoint.
> jobmanager_1 |
> org.apache.flink.runtime.entrypoint.ClusterEntrypointException: Failed to
> initialize the cluster entrypoint StandaloneSessionClusterEntrypoint.
> jobmanager_1 | at
> org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:189)
> jobmanager_1 | at
> org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runClusterEntrypoint(ClusterEntrypoint.java:520)
> jobmanager_1 | at
> org.apache.flink.runtime.entrypoint.StandaloneSessionClusterEntrypoint.main(StandaloneSessionClusterEntrypoint.java:64)
> jobmanager_1 | Caused by: java.io.IOException: Could not create storage
> directory for BLOB store in '/tmp'.
> jobmanager_1 | at
> org.apache.flink.runtime.blob.BlobUtils.initLocalStorageDirectory(BlobUtils.java:154)
> jobmanager_1 | at
> org.apache.flink.runtime.blob.BlobServer.<init>(BlobServer.java:140)
> jobmanager_1 | at
> org.apache.flink.runtime.entrypoint.ClusterEntrypoint.initializeServices(ClusterEntrypoint.java:266)
> jobmanager_1 | at
> org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:209)
> jobmanager_1 | at
> org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$0(ClusterEntrypoint.java:171)
> jobmanager_1 | at
> org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
> jobmanager_1 | at
> org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:170)
> jobmanager_1 | ... 2 more
>
> Any idea how I can solve it? Thanks!
>