You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@samza.apache.org by Jack Huang <ja...@mz.com> on 2016/06/11 02:01:06 UTC

Location of the RocksDB Key-Value store

Hi all,

I couldn't find in the documentation (
https://samza.apache.org/learn/documentation/latest/jobs/configuration-table.html)
where on the disk Samza stores the local RocksDB key-value store. Can
anyone tell me where it is and if it can be configured?


Thanks,
Jack

Re: Location of the RocksDB Key-Value store

Posted by Jack Huang <ja...@mz.com>.
Finally found it. Since I am using YARN, it is located under path specified
by *yarn.nodemanager.local-dirs *

On Sat, Jun 11, 2016 at 11:40 PM, David Yu <da...@optimizely.com> wrote:

> Not sure if it is configurable. But you should be able to find an entry in
> your samza log like this:
>
>
> /data/b/yarn/nm/usercache/david/appcache/application_1464853403568_0010/container_e04_1464853403568_0010_01_000002/state/session-store/Partition_14
>
> On Fri, Jun 10, 2016 at 7:01 PM, Jack Huang <ja...@mz.com> wrote:
>
> > Hi all,
> >
> > I couldn't find in the documentation (
> >
> >
> https://samza.apache.org/learn/documentation/latest/jobs/configuration-table.html
> > )
> > where on the disk Samza stores the local RocksDB key-value store. Can
> > anyone tell me where it is and if it can be configured?
> >
> >
> > Thanks,
> > Jack
> >
>

Re: Location of the RocksDB Key-Value store

Posted by David Yu <da...@optimizely.com>.
Not sure if it is configurable. But you should be able to find an entry in
your samza log like this:

/data/b/yarn/nm/usercache/david/appcache/application_1464853403568_0010/container_e04_1464853403568_0010_01_000002/state/session-store/Partition_14

On Fri, Jun 10, 2016 at 7:01 PM, Jack Huang <ja...@mz.com> wrote:

> Hi all,
>
> I couldn't find in the documentation (
>
> https://samza.apache.org/learn/documentation/latest/jobs/configuration-table.html
> )
> where on the disk Samza stores the local RocksDB key-value store. Can
> anyone tell me where it is and if it can be configured?
>
>
> Thanks,
> Jack
>