You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Yan Fang (JIRA)" <ji...@apache.org> on 2015/07/15 02:37:04 UTC

[jira] [Commented] (SAMZA-626) Read KV state store for a running job

    [ https://issues.apache.org/jira/browse/SAMZA-626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14627348#comment-14627348 ] 

Yan Fang commented on SAMZA-626:
--------------------------------

The idea of this ticket is to inspect the key/value in the state store when the job is running. Since the db's api varies, I only focus the rocksDb here. But there are a few limitations I want to talk about here:

1. it will only be able to read the state store in the local. It is a little difficult to access the db store in other machines: have to figure out the address, the path and the permission, etc.

2. if we use the command line, we can only read the a few key types: string, integer, long, etc. If the key is serialized in other formats, do not know how the command line can accept it. Also tries gradle's scalaConsole, but not a fan of this, because 1) we are moving away from the scala 2) this tool is poor documented 3) it's slow (maybe because of my machine or other issues).

Any thoughts about this? Thanks. 

> Read KV state store for a running job
> -------------------------------------
>
>                 Key: SAMZA-626
>                 URL: https://issues.apache.org/jira/browse/SAMZA-626
>             Project: Samza
>          Issue Type: Sub-task
>          Components: kv
>    Affects Versions: 0.10.0
>            Reporter: Yan Fang
>            Assignee: Yan Fang
>             Fix For: 0.10.0
>
>
> Provide the tool to connect to kv state store and read the content of the store.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)