You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@jackrabbit.apache.org by Bram de Kruijff <br...@gx.nl> on 2007/08/01 14:36:17 UTC

Easy way to migrate to externalBlobs?

Hi,

we need to convert a JackRabbit repository using bundle
persistencemanagers to use externalBlobs. I found that simply changing
the boolean in the workspace.xml does not work resulting in IOExceptions
when the files are accessed. Maybe I was too optimistic, but it could be
a feature right?

Fortunalty, using the import/export tool from the contrib section in svn
does the trick (export with externalBlobs=false and import on a fresh
repository with externalBlobs=true), but it takes a lot of time even an
a relatively small repository. Is there an easier way I may have
overlooked?

regards,
Bram

--
Bram de Kruijff
<GX> creative online development B.V.
 
t: 024 - 3888 261
f: 024 - 3888 621
e: bramk@gx.nl
 
Wijchenseweg 111
6538 SW Nijmegen
http://www.gx.nl/ 
KvK: 10044410

RE: Easy way to migrate to externalBlobs?

Posted by sbarriba <sb...@yahoo.co.uk>.
Hi Bram,
RE "high volume website with a jackrabbit cluster"

So are you planning to use external blobs with a fault tolerant shared file
system to achieve JackRabbit clustering? The 'only' reason we've put blobs
internal to the database is to achieve clustering/fault-tolerance.

Regards,
Shaun

-----Original Message-----
From: Bram de Kruijff [mailto:bramk@gx.nl] 
Sent: 01 August 2007 16:46
To: users@jackrabbit.apache.org
Subject: RE: Easy way to migrate to externalBlobs?

> Why are you migrating from internal to external?

At this point because I want to know we can and to be able to compare
performance. Our use-case will be a high volume website with a jackrabbit
cluster underneath. As all static content (mainly images) will be dumped to
disk anyway to be rsynced and served by httpd it would be a way to ease the
load on the db.

regards,
Bram


> -----Original Message-----
> From: sbarriba [mailto:sbarriba@yahoo.co.uk] 
> Sent: Wednesday, August 01, 2007 3:18 PM
> To: users@jackrabbit.apache.org
> Subject: RE: Easy way to migrate to externalBlobs?
> 
> Out of interest Bram.
> Why are you migrating from internal to external?
> Regards,
> Shaun.
> 
> -----Original Message-----
> From: Bram de Kruijff [mailto:bramk@gx.nl]
> Sent: 01 August 2007 13:36
> To: users@jackrabbit.apache.org
> Subject: Easy way to migrate to externalBlobs?
> 
> Hi,
> 
> we need to convert a JackRabbit repository using bundle 
> persistencemanagers to use externalBlobs. I found that simply 
> changing the boolean in the workspace.xml does not work 
> resulting in IOExceptions when the files are accessed. Maybe 
> I was too optimistic, but it could be a feature right?
> 
> Fortunalty, using the import/export tool from the contrib 
> section in svn does the trick (export with 
> externalBlobs=false and import on a fresh repository with 
> externalBlobs=true), but it takes a lot of time even an a 
> relatively small repository. Is there an easier way I may 
> have overlooked?
> 
> regards,
> Bram
> 
> --
> Bram de Kruijff
> <GX> creative online development B.V.
>  
> t: 024 - 3888 261
> f: 024 - 3888 621
> e: bramk@gx.nl
>  
> Wijchenseweg 111
> 6538 SW Nijmegen
> http://www.gx.nl/
> KvK: 10044410

RE: Easy way to migrate to externalBlobs?

Posted by Bram de Kruijff <br...@gx.nl>.
> Why are you migrating from internal to external?

At this point because I want to know we can and to be able to compare
performance. Our use-case will be a high volume website with a jackrabbit
cluster underneath. As all static content (mainly images) will be dumped to
disk anyway to be rsynced and served by httpd it would be a way to ease the
load on the db.

regards,
Bram


> -----Original Message-----
> From: sbarriba [mailto:sbarriba@yahoo.co.uk] 
> Sent: Wednesday, August 01, 2007 3:18 PM
> To: users@jackrabbit.apache.org
> Subject: RE: Easy way to migrate to externalBlobs?
> 
> Out of interest Bram.
> Why are you migrating from internal to external?
> Regards,
> Shaun.
> 
> -----Original Message-----
> From: Bram de Kruijff [mailto:bramk@gx.nl]
> Sent: 01 August 2007 13:36
> To: users@jackrabbit.apache.org
> Subject: Easy way to migrate to externalBlobs?
> 
> Hi,
> 
> we need to convert a JackRabbit repository using bundle 
> persistencemanagers to use externalBlobs. I found that simply 
> changing the boolean in the workspace.xml does not work 
> resulting in IOExceptions when the files are accessed. Maybe 
> I was too optimistic, but it could be a feature right?
> 
> Fortunalty, using the import/export tool from the contrib 
> section in svn does the trick (export with 
> externalBlobs=false and import on a fresh repository with 
> externalBlobs=true), but it takes a lot of time even an a 
> relatively small repository. Is there an easier way I may 
> have overlooked?
> 
> regards,
> Bram
> 
> --
> Bram de Kruijff
> <GX> creative online development B.V.
>  
> t: 024 - 3888 261
> f: 024 - 3888 621
> e: bramk@gx.nl
>  
> Wijchenseweg 111
> 6538 SW Nijmegen
> http://www.gx.nl/
> KvK: 10044410

RE: Easy way to migrate to externalBlobs?

Posted by sbarriba <sb...@yahoo.co.uk>.
Out of interest Bram.
Why are you migrating from internal to external?
Regards,
Shaun.

-----Original Message-----
From: Bram de Kruijff [mailto:bramk@gx.nl] 
Sent: 01 August 2007 13:36
To: users@jackrabbit.apache.org
Subject: Easy way to migrate to externalBlobs?

Hi,

we need to convert a JackRabbit repository using bundle
persistencemanagers to use externalBlobs. I found that simply changing
the boolean in the workspace.xml does not work resulting in IOExceptions
when the files are accessed. Maybe I was too optimistic, but it could be
a feature right?

Fortunalty, using the import/export tool from the contrib section in svn
does the trick (export with externalBlobs=false and import on a fresh
repository with externalBlobs=true), but it takes a lot of time even an
a relatively small repository. Is there an easier way I may have
overlooked?

regards,
Bram

--
Bram de Kruijff
<GX> creative online development B.V.
 
t: 024 - 3888 261
f: 024 - 3888 621
e: bramk@gx.nl
 
Wijchenseweg 111
6538 SW Nijmegen
http://www.gx.nl/ 
KvK: 10044410

Re: Easy way to migrate to externalBlobs?

Posted by Stefan Guggisberg <st...@gmail.com>.
On 8/1/07, Bram de Kruijff <br...@gx.nl> wrote:
> Hi,
>
> we need to convert a JackRabbit repository using bundle
> persistencemanagers to use externalBlobs. I found that simply changing
> the boolean in the workspace.xml does not work resulting in IOExceptions
> when the files are accessed. Maybe I was too optimistic, but it could be
> a feature right?
>
> Fortunalty, using the import/export tool from the contrib section in svn
> does the trick (export with externalBlobs=false and import on a fresh
> repository with externalBlobs=true), but it takes a lot of time even an
> a relatively small repository. Is there an easier way I may have
> overlooked?

how about creating a new workspace (using externalBlobs=true)
and then cloning the workspace?

http://www.day.com/maven/jsr170/javadocs/jcr-1.0/javax/jcr/Workspace.html#clone(java.lang.String,%20java.lang.String,%20java.lang.String,%20boolean)

cheers
stefan

>
> regards,
> Bram
>
> --
> Bram de Kruijff
> <GX> creative online development B.V.
>
> t: 024 - 3888 261
> f: 024 - 3888 621
> e: bramk@gx.nl
>
> Wijchenseweg 111
> 6538 SW Nijmegen
> http://www.gx.nl/
> KvK: 10044410
>

Re: Easy way to migrate to externalBlobs?

Posted by Phillip Rhodes <sp...@rhoderunner.com>.
I am doing the exact same thing this week.

My plan for now is to:
1) Export each binary blob to the filesystem
2) Change the repo config to use external blobs
3) add the binary blob to the node again using my program and the exported files.




----- Original Message -----
From: "Bram de Kruijff" <br...@gx.nl>
To: users@jackrabbit.apache.org
Sent: Wednesday, August 1, 2007 8:36:17 AM (GMT-0500) America/New_York
Subject: Easy way to migrate to externalBlobs?

Hi,

we need to convert a JackRabbit repository using bundle
persistencemanagers to use externalBlobs. I found that simply changing
the boolean in the workspace.xml does not work resulting in IOExceptions
when the files are accessed. Maybe I was too optimistic, but it could be
a feature right?

Fortunalty, using the import/export tool from the contrib section in svn
does the trick (export with externalBlobs=false and import on a fresh
repository with externalBlobs=true), but it takes a lot of time even an
a relatively small repository. Is there an easier way I may have
overlooked?

regards,
Bram

--
Bram de Kruijff
<GX> creative online development B.V.
 
t: 024 - 3888 261
f: 024 - 3888 621
e: bramk@gx.nl
 
Wijchenseweg 111
6538 SW Nijmegen
http://www.gx.nl/ 
KvK: 10044410