Re: RDF Delta Zookeper on S3 issue

[Piotr Nowara <pi...@gmail.com>]

Hi Andy,

thanks for your help. The problem was dataDir and dataLogDir set to
defaults (inside container). After mounting external folders for them data
persists between deployments.

Piotr

wt., 18 sie 2020 o 19:42 Andy Seaborne <an...@apache.org> napisał(a):

> Zookeeper has an external state - it's configuration file and it's
> persistent database on disk.
>
> If you use --zkConf then your zoo.cfg you'll have something like:
>
> dataDir=./ZkData
>
> and maybe
>
> dataLogDir=
>
> or have used --zkData
>
> for the snapshot of the in-memory database and the transaction log.
>
> If you're inside a container, the data areas will need to be external
> (bind volumes) or the data will be lost when the container goes away.
>
> ----
>
> BTW Just to be clear : RDF Delta is not part of Apache Jena.
>
> I'll leave it to the Jena user community wants email about it here or not.
>
>      Andy
>
> On 18/08/2020 13:29, Piotr Nowara wrote:
> > No, we don't do anything extra to preserve the data. We expected RDF
> Delta
> > would pick it up automatically. Could you clarify what you mean by
> > preserving? How can we apply it?
> >
> > Thanks,
> > Piotr
> >
> > pon., 17 sie 2020 o 19:06 Andy Seaborne <an...@apache.org> napisał(a):
> >
> >> Did you preserve the Zookeeper database when redeploying?
> >>
> >> That keeps the patch index. It is not rebuilt from S3.
> >>
> >>       Andy
> >>
> >> On 17/08/2020 17:05, Piotr Nowara wrote:
> >>> Hi,
> >>>
> >>> We are using RDF Delta with the Zookeeper/S3 integration. The issue is
> >>> after each redeploying of the docker compose image by Kubernetes all
> data
> >>> is gone despite the fact that the old patch files are still on S3
> server
> >>> but RDF Delta does not see the old ones. Is this expected? How could we
> >>> make RDF Delta use the old files which are already in the expected
> place?
> >>>
> >>> Thanks,
> >>> Piotr Nowara
> >>>
> >>
> >
>