You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user-zh@flink.apache.org by Lei Wang <le...@gmail.com> on 2020/12/28 08:21:21 UTC
Flink RocksDBStateBackend 可以设置阿里云 OSS 存储吗?
如题, 可以直接这样写吗?
env.setStateBackend(new RocksDBStateBackend(“oss://”, true));
谢谢,
王磊
Re: Flink RocksDBStateBackend 可以设置阿里云 OSS 存储吗?
Posted by seuzxc <ze...@gmail.com>.
我用oss设置,状态信息能写入,但是oss日志总是提示如下的信息,有遇到过吗?
2021-03-08 20:18:58.512 [INFO][cluster-io-thread-2]:
o.a.f.f.o.s.c.a.o.c.u.LogUtils 66 logException - [Server]Unable to execute
HTTP request: Not Found
[ErrorCode]: NoSuchKey
[RequestId]: 6046163285863333350B9C61
[HostId]: null
--
Sent from: http://apache-flink.147419.n8.nabble.com/
Re: Flink RocksDBStateBackend 可以设置阿里云 OSS 存储吗?
Posted by Yun Tang <my...@live.com>.
Hi 王磊,
当然是可以的,state backend的checkpoint地址其实依赖于Flink的file system实现,只要参照文档[1]的描述,对oss进行相关配置即可。
[1] https://ci.apache.org/projects/flink/flink-docs-stable/deployment/filesystems/oss.html#shaded-hadoop-oss-file-system
祝好
唐云
________________________________
From: Lei Wang <le...@gmail.com>
Sent: Monday, December 28, 2020 16:21
To: user-zh@flink.apache.org <us...@flink.apache.org>
Subject: Flink RocksDBStateBackend 可以设置阿里云 OSS 存储吗?
如题, 可以直接这样写吗?
env.setStateBackend(new RocksDBStateBackend(“oss://”, true));
谢谢,
王磊