You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by Otis Gospodnetic <ot...@yahoo.com> on 2009/01/05 23:21:04 UTC

Site update

Hello,

Quick heads up - I'm about to regenerate the files (HTML + PDF) for the site and update it tomorrow according to the instructions on http://wiki.apache.org/nutch/Website_Update_HOWTO .  I have Forrest 0.8, and the site files were last generated with Forrest 0.7, so there will be some changes that are the result of this version increase.  Locally, all HTML and PDF files generated with 0.8 look fine.  I haven't done this before for Nutch, so if there is something I should pay attention to, please let me know.


Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch


Re: Site update

Posted by Otis Gospodnetic <og...@yahoo.com>.
Right, that's exactly what I did.  I'll commit tomorrow.


Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch



----- Original Message ----
> From: Dennis Kubes <ku...@apache.org>
> To: nutch-dev@lucene.apache.org
> Sent: Monday, January 5, 2009 5:58:55 PM
> Subject: Re: Site update
> 
> http://www.mail-archive.com/dev@forrest.apache.org/msg15136.html
> 
> This might help.
> 
> Dennis
> 
> Andrzej Bialecki wrote:
> > Otis Gospodnetic wrote:
> >> Below is what it spits out.  I'm not sure what the cause is.  I did try 
> forrest seed && forrest validate as prescribed at 
> https://issues.apache.org/jira/browse/FOR-984?focusedCommentId=12649593#action_12649593 
> , but forrest validate failed.
> >> 
> >> validate-sitemap:
> >> 
> /home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:72:31: 
> error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not 
> recognized
> > 
> > [...]
> > 
> > No clue. I'd say that until we figure out what happens we can go forward - if 
> it generates a consistent and usable output.
> > 
> > 


Re: Site update

Posted by Dennis Kubes <ku...@apache.org>.
http://www.mail-archive.com/dev@forrest.apache.org/msg15136.html

This might help.

Dennis

Andrzej Bialecki wrote:
> Otis Gospodnetic wrote:
>> Below is what it spits out.  I'm not sure what the cause is.  I did 
>> try forrest seed && forrest validate as prescribed at 
>> https://issues.apache.org/jira/browse/FOR-984?focusedCommentId=12649593#action_12649593 
>> , but forrest validate failed.
>>
>> validate-sitemap:
>> /home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:72:31: 
>> error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" 
>> not recognized
> 
> [...]
> 
> No clue. I'd say that until we figure out what happens we can go forward 
> - if it generates a consistent and usable output.
> 
> 

Re: Site update

Posted by Andrzej Bialecki <ab...@getopt.org>.
Otis Gospodnetic wrote:
> Below is what it spits out.  I'm not sure what the cause is.  I did try forrest seed && forrest validate as prescribed at https://issues.apache.org/jira/browse/FOR-984?focusedCommentId=12649593#action_12649593 , but forrest validate failed.
> 
> validate-sitemap:
> /home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:72:31: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized

[...]

No clue. I'd say that until we figure out what happens we can go forward 
- if it generates a consistent and usable output.


-- 
Best regards,
Andrzej Bialecki     <><
  ___. ___ ___ ___ _ _   __________________________________
[__ || __|__/|__||\/|  Information Retrieval, Semantic Web
___|||__||  \|  ||  |  Embedded Unix, System Integration
http://www.sigram.com  Contact: info at sigram dot com


Re: Site update

Posted by Otis Gospodnetic <og...@yahoo.com>.
Below is what it spits out.  I'm not sure what the cause is.  I did try forrest seed && forrest validate as prescribed at https://issues.apache.org/jira/browse/FOR-984?focusedCommentId=12649593#action_12649593 , but forrest validate failed.

validate-sitemap:
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:72:31: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:81:31: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:96:28: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:102:28: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:109:28: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:115:28: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:122:28: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:128:28: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:138:40: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:143:43: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:148:40: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:157:31: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:167:31: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:172:31: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:177:31: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:195:31: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:203:30: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:215:30: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:225:31: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:371:34: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:608:29: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:618:29: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:642:29: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:666:29: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:705:68: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:761:29: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:771:29: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:781:29: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:791:29: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:839:38: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:981:29: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:991:29: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:1001:29: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:2053:29: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:2087:29: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:2097:30: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized
/home/otis/apache-forrest/main/webapp/resources/schema/relaxng/sitemap-v06.rng:2107:29: error: datatype library "http://www.w3.org/2001/XMLSchema-datatypes" not recognized

BUILD FAILED
/home/otis/apache-forrest/main/targets/validate.xml:158: Validation failed, messages should have been provided.


Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch



----- Original Message ----
> From: Andrzej Bialecki <ab...@getopt.org>
> To: nutch-dev@lucene.apache.org
> Sent: Monday, January 5, 2009 5:28:45 PM
> Subject: Re: Site update
> 
> Otis Gospodnetic wrote:
> > One more thing.  Forrest 0.8 wouldn't generate site files without me
> > making the following change (so I'll commit this, too, unless
> > somebody thinks this is bad):
> 
> Does it say why the sitemap is invalid?
> 
> 
> -- Best regards,
> Andrzej Bialecki     <><
> ___. ___ ___ ___ _ _   __________________________________
> [__ || __|__/|__||\/|  Information Retrieval, Semantic Web
> ___|||__||  \|  ||  |  Embedded Unix, System Integration
> http://www.sigram.com  Contact: info at sigram dot com


Re: Site update

Posted by Andrzej Bialecki <ab...@getopt.org>.
Otis Gospodnetic wrote:
> One more thing.  Forrest 0.8 wouldn't generate site files without me
> making the following change (so I'll commit this, too, unless
> somebody thinks this is bad):

Does it say why the sitemap is invalid?


-- 
Best regards,
Andrzej Bialecki     <><
  ___. ___ ___ ___ _ _   __________________________________
[__ || __|__/|__||\/|  Information Retrieval, Semantic Web
___|||__||  \|  ||  |  Embedded Unix, System Integration
http://www.sigram.com  Contact: info at sigram dot com


Re: Site update

Posted by "Mattmann, Chris A" <ch...@jpl.nasa.gov>.
Hey Otis,

Weird, must have been caused when I checked out SVN and updated the site
last time?

Anyways, I ran chmod -R g+w from the top level nutch site checkout, so give
it a try now...

Cheers,
Chris



On 1/6/09 8:30 AM, "Otis Gospodnetic" <og...@yahoo.com> wrote:

> Hm, permission problem.  I *think* I need Chris' help with this:
>
> [otis@minotaur /www/lucene.apache.org/nutch]$ svn up
> svn: Can't open file 'skin/translations/.svn/lock': Permission denied
>
> [otis@minotaur /www/lucene.apache.org/nutch]$ groups
> otis apcvs jakarta incubator lucene
>
> [otis@minotaur /www/lucene.apache.org/nutch]$ umask
> 0022
>
> [otis@minotaur /www/lucene.apache.org/nutch]$ ls -al skin/translations/.svn/
> total 18
> drwxr-xr-x  6 mattmann  lucene  512 Apr  6  2007 .                  <== lucene
> group, but not writable; Chris owns it
> drwxr-xr-x  3 mattmann  lucene  512 Apr  6  2007 ..
> -r--r--r--  1 mattmann  lucene  109 Apr  6  2007 all-wcprops
> -r--r--r--  1 mattmann  lucene  260 Apr  6  2007 entries
> -r--r--r--  1 mattmann  lucene    2 Apr  6  2007 format
> drwxr-xr-x  2 mattmann  lucene  512 Apr  6  2007 prop-base
> drwxr-xr-x  2 mattmann  lucene  512 Apr  6  2007 props
> drwxr-xr-x  2 mattmann  lucene  512 Apr  6  2007 text-base
> drwxr-xr-x  5 mattmann  lucene  512 Apr  6  2007 tmp
>
>
>
> It looks like the problem is that I don't have write permissions there:
>
> [otis@minotaur /www/lucene.apache.org/nutch]$ touch skin/translations/.svn/foo
> touch: skin/translations/.svn/foo: Permission denied
>
> [otis@minotaur /www/lucene.apache.org/nutch]$ chmod g+w skin/translations/.svn
> chmod: skin/translations/.svn: Operation not permitted
>
> Otis
> --
> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>
>
>
> ----- Original Message ----
>> From: Otis Gospodnetic <og...@yahoo.com>
>> To: nutch-dev@lucene.apache.org
>> Sent: Monday, January 5, 2009 5:24:39 PM
>> Subject: Re: Site update
>>
>> One more thing.  Forrest 0.8 wouldn't generate site files without me making
>> the
>> following change (so I'll commit this, too, unless somebody thinks this is
>> bad):
>>
>> $ svn diff src/site
>> Index: src/site/forrest.properties
>> ===================================================================
>> --- src/site/forrest.properties (revision 729973)
>> +++ src/site/forrest.properties (working copy)
>> @@ -73,6 +73,7 @@
>> #forrest.validate.stylesheets=${forrest.validate}
>> #forrest.validate.skins=${forrest.validate}
>> #forrest.validate.skins.stylesheets=${forrest.validate.skins}
>> +forrest.validate.sitemap=false
>>
>> # *.failonerror=(true|false) - stop when an XML file is invalid
>> #forrest.validate.failonerror=true
>>
>>
>> Otis
>> --
>> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>>
>>
>>
>> ----- Original Message ----
>>> From: Otis Gospodnetic
>>> To: Nutch Developer List
>>> Sent: Monday, January 5, 2009 5:21:04 PM
>>> Subject: Site update
>>>
>>> Hello,
>>>
>>> Quick heads up - I'm about to regenerate the files (HTML + PDF) for the site
>> and
>>> update it tomorrow according to the instructions on
>>> http://wiki.apache.org/nutch/Website_Update_HOWTO .  I have Forrest 0.8, and
>> the
>>> site files were last generated with Forrest 0.7, so there will be some
>>> changes
>>
>>> that are the result of this version increase.  Locally, all HTML and PDF
>>> files
>>
>>> generated with 0.8 look fine.  I haven't done this before for Nutch, so if
>> there
>>> is something I should pay attention to, please let me know.
>>>
>>>
>>> Otis
>>> --
>>> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>
>

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: Chris.Mattmann@jpl.nasa.gov
WWW:   http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Disclaimer:  The opinions presented within are my own and do not reflect
those of either NASA, JPL, or the California Institute of Technology.



Re: Site update

Posted by Otis Gospodnetic <og...@yahoo.com>.
Hm, permission problem.  I *think* I need Chris' help with this:

[otis@minotaur /www/lucene.apache.org/nutch]$ svn up
svn: Can't open file 'skin/translations/.svn/lock': Permission denied

[otis@minotaur /www/lucene.apache.org/nutch]$ groups
otis apcvs jakarta incubator lucene

[otis@minotaur /www/lucene.apache.org/nutch]$ umask
0022

[otis@minotaur /www/lucene.apache.org/nutch]$ ls -al skin/translations/.svn/
total 18
drwxr-xr-x  6 mattmann  lucene  512 Apr  6  2007 .                  <== lucene group, but not writable; Chris owns it
drwxr-xr-x  3 mattmann  lucene  512 Apr  6  2007 ..
-r--r--r--  1 mattmann  lucene  109 Apr  6  2007 all-wcprops
-r--r--r--  1 mattmann  lucene  260 Apr  6  2007 entries
-r--r--r--  1 mattmann  lucene    2 Apr  6  2007 format
drwxr-xr-x  2 mattmann  lucene  512 Apr  6  2007 prop-base
drwxr-xr-x  2 mattmann  lucene  512 Apr  6  2007 props
drwxr-xr-x  2 mattmann  lucene  512 Apr  6  2007 text-base
drwxr-xr-x  5 mattmann  lucene  512 Apr  6  2007 tmp



It looks like the problem is that I don't have write permissions there:

[otis@minotaur /www/lucene.apache.org/nutch]$ touch skin/translations/.svn/foo
touch: skin/translations/.svn/foo: Permission denied

[otis@minotaur /www/lucene.apache.org/nutch]$ chmod g+w skin/translations/.svn 
chmod: skin/translations/.svn: Operation not permitted

Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch



----- Original Message ----
> From: Otis Gospodnetic <og...@yahoo.com>
> To: nutch-dev@lucene.apache.org
> Sent: Monday, January 5, 2009 5:24:39 PM
> Subject: Re: Site update
> 
> One more thing.  Forrest 0.8 wouldn't generate site files without me making the 
> following change (so I'll commit this, too, unless somebody thinks this is bad):
> 
> $ svn diff src/site
> Index: src/site/forrest.properties
> ===================================================================
> --- src/site/forrest.properties (revision 729973)
> +++ src/site/forrest.properties (working copy)
> @@ -73,6 +73,7 @@
> #forrest.validate.stylesheets=${forrest.validate}
> #forrest.validate.skins=${forrest.validate}
> #forrest.validate.skins.stylesheets=${forrest.validate.skins}
> +forrest.validate.sitemap=false
> 
> # *.failonerror=(true|false) - stop when an XML file is invalid
> #forrest.validate.failonerror=true
> 
> 
> Otis
> --
> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
> 
> 
> 
> ----- Original Message ----
> > From: Otis Gospodnetic 
> > To: Nutch Developer List 
> > Sent: Monday, January 5, 2009 5:21:04 PM
> > Subject: Site update
> > 
> > Hello,
> > 
> > Quick heads up - I'm about to regenerate the files (HTML + PDF) for the site 
> and 
> > update it tomorrow according to the instructions on 
> > http://wiki.apache.org/nutch/Website_Update_HOWTO .  I have Forrest 0.8, and 
> the 
> > site files were last generated with Forrest 0.7, so there will be some changes 
> 
> > that are the result of this version increase.  Locally, all HTML and PDF files 
> 
> > generated with 0.8 look fine.  I haven't done this before for Nutch, so if 
> there 
> > is something I should pay attention to, please let me know.
> > 
> > 
> > Otis
> > --
> > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch


Re: Site update

Posted by Otis Gospodnetic <og...@yahoo.com>.
One more thing.  Forrest 0.8 wouldn't generate site files without me making the following change (so I'll commit this, too, unless somebody thinks this is bad):

$ svn diff src/site
Index: src/site/forrest.properties
===================================================================
--- src/site/forrest.properties (revision 729973)
+++ src/site/forrest.properties (working copy)
@@ -73,6 +73,7 @@
 #forrest.validate.stylesheets=${forrest.validate}
 #forrest.validate.skins=${forrest.validate}
 #forrest.validate.skins.stylesheets=${forrest.validate.skins}
+forrest.validate.sitemap=false
 
 # *.failonerror=(true|false) - stop when an XML file is invalid
 #forrest.validate.failonerror=true


Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch



----- Original Message ----
> From: Otis Gospodnetic <ot...@yahoo.com>
> To: Nutch Developer List <nu...@lucene.apache.org>
> Sent: Monday, January 5, 2009 5:21:04 PM
> Subject: Site update
> 
> Hello,
> 
> Quick heads up - I'm about to regenerate the files (HTML + PDF) for the site and 
> update it tomorrow according to the instructions on 
> http://wiki.apache.org/nutch/Website_Update_HOWTO .  I have Forrest 0.8, and the 
> site files were last generated with Forrest 0.7, so there will be some changes 
> that are the result of this version increase.  Locally, all HTML and PDF files 
> generated with 0.8 look fine.  I haven't done this before for Nutch, so if there 
> is something I should pay attention to, please let me know.
> 
> 
> Otis
> --
> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch