You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by sohimankotia <so...@gmail.com> on 2017/08/31 07:33:01 UTC

Rest API for Checkpoint Data

Is there way to read checkpoint ( if not configured to save to hdfs ) data
through rest api (or some other way) for monitoring purpose ?



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Rest API for Checkpoint Data

Posted by sohimankotia <so...@gmail.com>.
Can you point to code to  deserialize this data ? That would be great .



--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Rest API for Checkpoint Data

Posted by Aljoscha Krettek <al...@apache.org>.
Hi,

This is the serialised data for the checkpoint. This is not meant to be user readable, though. There are some plans to make savepoints adhere to a specific schema, so that you could inspect savepoints (which are similar to checkpoints, but with additional metadata [1]). I'm not sure whether this will make it into Flink 1.4, though.

Best,
Aljoscha

[1] https://ci.apache.org/projects/flink/flink-docs-release-1.4/ops/state/savepoints.html <https://ci.apache.org/projects/flink/flink-docs-release-1.4/ops/state/savepoints.html>

> On 4. Sep 2017, at 12:38, sohimankotia <so...@gmail.com> wrote:
> 
> I tried to use file system as Backend store .
> 
> env.setStateBackend(new
> FsStateBackend("file:///home/user/Desktop/data/flink/checkpoints"));
> 
> 
> After running job on local , I see a folder with name
> *a2716e2992bfb6f8796347328ec23c82* under directory 
> 
> /home/user/Desktop/data/flink/checkpoints .
> 
> What exactly this means ? How to read it ? :-)
> 
> 
> 
> 
> 
> 
> --
> Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/


Re: Rest API for Checkpoint Data

Posted by sohimankotia <so...@gmail.com>.
I tried to use file system as Backend store .

env.setStateBackend(new
FsStateBackend("file:///home/user/Desktop/data/flink/checkpoints"));


After running job on local , I see a folder with name
*a2716e2992bfb6f8796347328ec23c82* under directory 

/home/user/Desktop/data/flink/checkpoints .

What exactly this means ? How to read it ? :-)

 




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Rest API for Checkpoint Data

Posted by Aljoscha Krettek <al...@apache.org>.
Hi,

No, I'm afraid this is not possible. Why can't you write the data to some file system?

Best,
Aljoscha

> On 31. Aug 2017, at 09:33, sohimankotia <so...@gmail.com> wrote:
> 
> Is there way to read checkpoint ( if not configured to save to hdfs ) data
> through rest api (or some other way) for monitoring purpose ?
> 
> 
> 
> --
> Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/