You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-dev@lucene.apache.org by "Philip Jacob (JIRA)" <ji...@apache.org> on 2006/07/16 06:04:13 UTC
[jira] Created: (SOLR-29) backup utility does not work on OS X
backup utility does not work on OS X
------------------------------------
Key: SOLR-29
URL: http://issues.apache.org/jira/browse/SOLR-29
Project: Solr
Issue Type: Bug
Environment: Darwin berlin.local 8.7.1 Darwin Kernel Version 8.7.1: Wed Jun 7 16:19:56 PDT 2006; root:xnu-792.9.72.obj~2/RELEASE_I386 i386 i386
Reporter: Philip Jacob
The 'cp' command on OS X doesn't support the -l option, so the backup script doesn't work.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [jira] Commented: (SOLR-29) backup utility does not work on OS X
Posted by Bill Au <bi...@gmail.com>.
Exactly. That's why I am thinking backup should take regular copies
of the index files instead of using hard links.
In any case, I will open a different bug for snapshooter since that
doesn't work on OS X for the same reason.
Bill
On 7/19/06, Yonik Seeley (JIRA) <ji...@apache.org> wrote:
> [ http://issues.apache.org/jira/browse/SOLR-29?page=comments#action_12422162 ]
>
> Yonik Seeley commented on SOLR-29:
> ----------------------------------
>
> That is a point...
> Lucene never changes segment files, so it's not a problem there, *but* if there is disk corruption, or if someone goes and manually edits a segment file with vi or something, then the "backup" will also be affected.
>
> > backup utility does not work on OS X
> > ------------------------------------
> >
> > Key: SOLR-29
> > URL: http://issues.apache.org/jira/browse/SOLR-29
> > Project: Solr
> > Issue Type: Bug
> > Environment: Darwin berlin.local 8.7.1 Darwin Kernel Version 8.7.1: Wed Jun 7 16:19:56 PDT 2006; root:xnu-792.9.72.obj~2/RELEASE_I386 i386 i386
> > Reporter: Philip Jacob
> >
> > The 'cp' command on OS X doesn't support the -l option, so the backup script doesn't work.
>
> --
> This message is automatically generated by JIRA.
> -
> If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
> -
> For more information on JIRA, see: http://www.atlassian.com/software/jira
>
>
>
[jira] Commented: (SOLR-29) backup utility does not work on OS X
Posted by "Bill Au (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/SOLR-29?page=comments#action_12422107 ]
Bill Au commented on SOLR-29:
-----------------------------
Snapshots are taken using "cp -l" to save space using hard links. I didn't realize until now that bacukp are taken the same way. So the backups are not really backups in the traditional sense because any changes made to the backups (besides removing an index file) are reflected in the original also. Do folks think that this will be an issue?
Should we make "regular" copies for backups?
> backup utility does not work on OS X
> ------------------------------------
>
> Key: SOLR-29
> URL: http://issues.apache.org/jira/browse/SOLR-29
> Project: Solr
> Issue Type: Bug
> Environment: Darwin berlin.local 8.7.1 Darwin Kernel Version 8.7.1: Wed Jun 7 16:19:56 PDT 2006; root:xnu-792.9.72.obj~2/RELEASE_I386 i386 i386
> Reporter: Philip Jacob
>
> The 'cp' command on OS X doesn't support the -l option, so the backup script doesn't work.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Resolved: (SOLR-29) backup utility does not work on OS X
Posted by "Grant Ingersoll (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-29?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Grant Ingersoll resolved SOLR-29.
---------------------------------
Resolution: Won't Fix
Fix Version/s: 1.4
The new Java based replication works fine on OS X and can handle backups
> backup utility does not work on OS X
> ------------------------------------
>
> Key: SOLR-29
> URL: https://issues.apache.org/jira/browse/SOLR-29
> Project: Solr
> Issue Type: Bug
> Environment: Darwin berlin.local 8.7.1 Darwin Kernel Version 8.7.1: Wed Jun 7 16:19:56 PDT 2006; root:xnu-792.9.72.obj~2/RELEASE_I386 i386 i386
> Reporter: Philip Jacob
> Fix For: 1.4
>
>
> The 'cp' command on OS X doesn't support the -l option, so the backup script doesn't work.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (SOLR-29) backup utility does not work on OS X
Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/SOLR-29?page=comments#action_12422499 ]
Yonik Seeley commented on SOLR-29:
----------------------------------
Do a switch based on uname, so most systems could use the existing cp -l ?
> backup utility does not work on OS X
> ------------------------------------
>
> Key: SOLR-29
> URL: http://issues.apache.org/jira/browse/SOLR-29
> Project: Solr
> Issue Type: Bug
> Environment: Darwin berlin.local 8.7.1 Darwin Kernel Version 8.7.1: Wed Jun 7 16:19:56 PDT 2006; root:xnu-792.9.72.obj~2/RELEASE_I386 i386 i386
> Reporter: Philip Jacob
>
> The 'cp' command on OS X doesn't support the -l option, so the backup script doesn't work.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (SOLR-29) backup utility does not work on OS X
Posted by "Hoss Man (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/SOLR-29?page=comments#action_12422497 ]
Hoss Man commented on SOLR-29:
------------------------------
i'm a little worried about the possibility of "ln index/* snapshot/" failing when there are a large number of files in the index and the wildcard expansion overwhelms the shells max command length (or whatever the limitation is ... i'm not much of a shell programming guy, i just remember we had a similar problem with "ls -1 *" in snapcleaner didn't we?)
> backup utility does not work on OS X
> ------------------------------------
>
> Key: SOLR-29
> URL: http://issues.apache.org/jira/browse/SOLR-29
> Project: Solr
> Issue Type: Bug
> Environment: Darwin berlin.local 8.7.1 Darwin Kernel Version 8.7.1: Wed Jun 7 16:19:56 PDT 2006; root:xnu-792.9.72.obj~2/RELEASE_I386 i386 i386
> Reporter: Philip Jacob
>
> The 'cp' command on OS X doesn't support the -l option, so the backup script doesn't work.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (SOLR-29) backup utility does not work on OS X
Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/SOLR-29?page=comments#action_12421894 ]
Yonik Seeley commented on SOLR-29:
----------------------------------
Would something like this work on OS X?
ln index/* snapshot/
> backup utility does not work on OS X
> ------------------------------------
>
> Key: SOLR-29
> URL: http://issues.apache.org/jira/browse/SOLR-29
> Project: Solr
> Issue Type: Bug
> Environment: Darwin berlin.local 8.7.1 Darwin Kernel Version 8.7.1: Wed Jun 7 16:19:56 PDT 2006; root:xnu-792.9.72.obj~2/RELEASE_I386 i386 i386
> Reporter: Philip Jacob
>
> The 'cp' command on OS X doesn't support the -l option, so the backup script doesn't work.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (SOLR-29) backup utility does not work on OS X
Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/SOLR-29?page=comments#action_12422162 ]
Yonik Seeley commented on SOLR-29:
----------------------------------
That is a point...
Lucene never changes segment files, so it's not a problem there, *but* if there is disk corruption, or if someone goes and manually edits a segment file with vi or something, then the "backup" will also be affected.
> backup utility does not work on OS X
> ------------------------------------
>
> Key: SOLR-29
> URL: http://issues.apache.org/jira/browse/SOLR-29
> Project: Solr
> Issue Type: Bug
> Environment: Darwin berlin.local 8.7.1 Darwin Kernel Version 8.7.1: Wed Jun 7 16:19:56 PDT 2006; root:xnu-792.9.72.obj~2/RELEASE_I386 i386 i386
> Reporter: Philip Jacob
>
> The 'cp' command on OS X doesn't support the -l option, so the backup script doesn't work.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (SOLR-29) backup utility does not work on OS X
Posted by "Hoss Man (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/SOLR-29?page=comments#action_12422812 ]
Hoss Man commented on SOLR-29:
------------------------------
i remeber thinking the hard link was weird the first time i noticed it -- but then i figured it was acctually kind of cool because it saved space ... the idea of backup corruption because people muck with the live index files (external of Solr) isn't something i ever considered.
I think ditching the hard links is a good idea.
> backup utility does not work on OS X
> ------------------------------------
>
> Key: SOLR-29
> URL: http://issues.apache.org/jira/browse/SOLR-29
> Project: Solr
> Issue Type: Bug
> Environment: Darwin berlin.local 8.7.1 Darwin Kernel Version 8.7.1: Wed Jun 7 16:19:56 PDT 2006; root:xnu-792.9.72.obj~2/RELEASE_I386 i386 i386
> Reporter: Philip Jacob
>
> The 'cp' command on OS X doesn't support the -l option, so the backup script doesn't work.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (SOLR-29) backup utility does not work on OS X
Posted by "Bill Au (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/SOLR-29?page=comments#action_12422660 ]
Bill Au commented on SOLR-29:
-----------------------------
Good point, Hoss. I will do some experimenting when I have access to my OS X box.
I am thinking of using find and xargs. I need to verify that they work the same way on OS X.
Yes, we can either do a switch based on uname or test to see if cp supports the -l option.
I am pretty sure the problem can be fixed. The only open issue for me is the use of hard link for backup.
> backup utility does not work on OS X
> ------------------------------------
>
> Key: SOLR-29
> URL: http://issues.apache.org/jira/browse/SOLR-29
> Project: Solr
> Issue Type: Bug
> Environment: Darwin berlin.local 8.7.1 Darwin Kernel Version 8.7.1: Wed Jun 7 16:19:56 PDT 2006; root:xnu-792.9.72.obj~2/RELEASE_I386 i386 i386
> Reporter: Philip Jacob
>
> The 'cp' command on OS X doesn't support the -l option, so the backup script doesn't work.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (SOLR-29) backup utility does not work on OS X
Posted by "Bill Au (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/SOLR-29?page=comments#action_12422433 ]
Bill Au commented on SOLR-29:
-----------------------------
Exactly. That's why I am leaning towards not using hard links for backup.
By the way,
ln index/* snapshot/
does work on OS X.
I will open up separate bug to modify snapshooter to do that so that snapshots can be taken on OS X.
> backup utility does not work on OS X
> ------------------------------------
>
> Key: SOLR-29
> URL: http://issues.apache.org/jira/browse/SOLR-29
> Project: Solr
> Issue Type: Bug
> Environment: Darwin berlin.local 8.7.1 Darwin Kernel Version 8.7.1: Wed Jun 7 16:19:56 PDT 2006; root:xnu-792.9.72.obj~2/RELEASE_I386 i386 i386
> Reporter: Philip Jacob
>
> The 'cp' command on OS X doesn't support the -l option, so the backup script doesn't work.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira