You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spamassassin.apache.org by "Warren Togami Jr." <wt...@gmail.com> on 2011/06/17 05:01:58 UTC

Confusion in website update

> - update the 'doc' tree in the SpamAssassin website (WARNING: if you're
>   moving to a new major release, x.y.0, you need to edit
>   'build/update_website_docs' beforehand and set the "vers" line):
>
>         cd /var/www/buildbot.spamassassin.org/staging/website
>         svn up
>         svn delete --force full/3.3.x
>         svn commit -m "removing old doc tree from website" full

Not sure what this did...

>
>         cd [checkedoutdir]
>         build/update_website_docs

Has anyone other than jm ever run this?  It isn't clear what host this 
is supposed to be run upon.  zones like the previous step?

I made two modifications in an attempt to make it work as documented:
* ln -s /export/home/wtogami/sabuildtools/bin/perl 
/export/home/wtogami/spamassassin-3.3/perl
* Added /var to the beginning of the path...

bash-3.00$ pwd
/export/home/wtogami/spamassassin-3.3
bash-3.00$ hostname
spamassassin.zones.apache.org
bash-3.00$ pwd
/export/home/wtogami/spamassassin-3.3
bash-3.00$ svn up
At revision 1136754.
bash-3.00$ ls -l perl
lrwxrwxrwx   1 wtogami  other         42 Jun 17 01:58 perl -> 
/export/home/wtogami/sabuildtools/bin/perl
bash-3.00$ svn diff
Index: build/update_website_docs
===================================================================
--- build/update_website_docs   (revision 1136754)
+++ build/update_website_docs   (working copy)
@@ -1,6 +1,6 @@
  #!/bin/sh

-WEBDIR=/www/spamassassin.apache.org
+WEBDIR=/var/www/spamassassin.apache.org
  vers=3.3.x

  if [ -z "$PERL" ]; then

Then the script completes but with error messages like the following 
because /var/www/spamassassin.apache.org is entirely absent on this host.

mkdir: Failed to make directory 
"/var/www/spamassassin.apache.org/full/3.3.x"; No such file or directory
build/update_website_docs: /var/www/spamassassin.apache.org/full/3.3.x: 
does not exist
tar: --exclude=.#*chmod: : No such file or directory
WARNING: can't access /var/www/spamassassin.apache.org/full/3.3.x


>
>         cd /var/www/buildbot.spamassassin.org/staging/website
>         svn add full/3.3.x
>         svn commit -m "updating new doc tree on website" full

Didn't get this far...

Warren

Re: Confusion in website update

Posted by Michael Parker <pa...@pobox.com>.
On Jun 21, 2011, at 8:38 PM, Warren Togami Jr. wrote:

> The instructions are confusing and do not appear to reflect reality.  I do not want to risk breaking anything by digging deeper when I have insufficient time to fix it if anything goes wrong.
> 
>> - update the 'doc' tree in the SpamAssassin website (WARNING: if you're
>>  moving to a new major release, x.y.0, you need to edit
>>  'build/update_website_docs' beforehand and set the "vers" line):
>> 
>>        cd /var/www/buildbot.spamassassin.org/staging/website
>>        svn up
>>        svn delete --force full/3.3.x
>>        svn commit -m "removing old doc tree from website" full
> 
> Given that /var/www does not exist on people.apache.org, it appears this can only be run on spamassassin.zones.apache.org.  This step succeeded there.
> 
>> 
>>        cd [checkedoutdir]
>>        build/update_website_docs
> 
> It wasn't clear what exactly [checkedoutdir] meant, but this succeeded in a private checkout of spamassassin-3.3 on people.apache.org with Kevin's new perl-5.14.  This script expects /www/spamassassin.apache.org to exist for it to complete without errors.
> 
>> 
>>        cd /var/www/buildbot.spamassassin.org/staging/website
>>        svn add full/3.3.x
>>        svn commit -m "updating new doc tree on website" full
> 
> On people.apache.org, /var/www does not exist. /www/buildbot.spamassassin.org does not exist either.  Going back to spamassassin.zones.apache.org, /var/www/buildbot.spamassassin.org/staging/website does exist, but there exists no full/3.3.x/ directory.
> 
> Who did this last time?  Were you following the build/README directions to the letter?

Agree, things are confusing, but I think it's pretty easy to work through the steps and jump over whatever places that need to be fixed.  I ended up doing it in a very hackish way because my shell on the zones machine was goofed up and I didn't feel like fighting it.  I think we can greatly simplify things, but don't have a whole lot of time to update the document.

I've got the docs committed and the live website is now updated.

The files were not in the dist/spamassassin/source directory so I copied those over and updated the download link timestamp.

I re-ran webmake and pushed the changes to the live site.

Just waiting on the live site to get rsync'd now.

I updated the tag and am currently uploading the CPAN.

I'll leave it to you to send out the announce to all the various lists.

Michael



> 
> Warren


Re: Confusion in website update

Posted by "Warren Togami Jr." <wt...@gmail.com>.
The instructions are confusing and do not appear to reflect reality.  I 
do not want to risk breaking anything by digging deeper when I have 
insufficient time to fix it if anything goes wrong.

> - update the 'doc' tree in the SpamAssassin website (WARNING: if you're
>   moving to a new major release, x.y.0, you need to edit
>   'build/update_website_docs' beforehand and set the "vers" line):
>
>         cd /var/www/buildbot.spamassassin.org/staging/website
>         svn up
>         svn delete --force full/3.3.x
>         svn commit -m "removing old doc tree from website" full

Given that /var/www does not exist on people.apache.org, it appears this 
can only be run on spamassassin.zones.apache.org.  This step succeeded 
there.

>
>         cd [checkedoutdir]
>         build/update_website_docs

It wasn't clear what exactly [checkedoutdir] meant, but this succeeded 
in a private checkout of spamassassin-3.3 on people.apache.org with 
Kevin's new perl-5.14.  This script expects /www/spamassassin.apache.org 
to exist for it to complete without errors.

>
>         cd /var/www/buildbot.spamassassin.org/staging/website
>         svn add full/3.3.x
>         svn commit -m "updating new doc tree on website" full

On people.apache.org, /var/www does not exist. 
/www/buildbot.spamassassin.org does not exist either.  Going back to 
spamassassin.zones.apache.org, 
/var/www/buildbot.spamassassin.org/staging/website does exist, but there 
exists no full/3.3.x/ directory.

Who did this last time?  Were you following the build/README directions 
to the letter?

Warren

Re: Confusion in website update

Posted by "Kevin A. McGrail" <KM...@PCCC.com>.
I looked into switching to the ASF CMS 
(http://apache.org/dev/cms.html).  I have to admit, the learning curve 
for the ASF CMS looks somewhat steep.  Anyone used the framework before?

Next step really is to ask for a staging website ala 
https://issues.apache.org/jira/browse/INFRA-3674.

Likely will want to create a new svn repo on our side of things.

How can we create something like cmssite off of this hierarchy?

http://svn.apache.org/repos/asf/spamassassin/

Regards,
KAM


On 6/21/2011 5:10 AM, Justin Mason wrote:
> btw, now that the ASF have a CMS system, it may be worth investigating
> a "port" to that away from webmake -- the problem with the latter is
> that it's hard to get a stable foundation to build it on, and an
> officially-supported CMS would avoid that.
>
> --j.
>
> On Tue, Jun 21, 2011 at 03:43, Kevin A. McGrail<KM...@pccc.com>  wrote:
>> On 6/20/2011 9:46 PM, Kevin A. McGrail wrote:
>>
>> Will fix. They updated ssl I think.
>> Regards,
>> KAM
>>
>> "Warren Togami Jr."<wt...@gmail.com>  wrote:
>>> I tried the perl in your homedir on people, and it seems to be broken
>>> because libraries you linked to back in 2009 (or earlier?) have changed
>>> on the underling server.
>> Try the perl in /home/kmcgrail/usr/local/bin
>>
>> That's now 5.14.0 with all the prereqs for Mail::SpamAssassin as well as
>> WebMake 2.4 + prereqs.
>>
>> Regards,
>> KAM
>>
>>
>>


-- 
*Kevin A. McGrail*
President

Peregrine Computer Consulting Corporation
3927 Old Lee Highway, Suite 102-C
Fairfax, VA 22030-2422

http://www.pccc.com/

703-359-9700 x50 / 800-823-8402 (Toll-Free)
703-359-8451 (fax)
KMcGrail@PCCC.com <ma...@pccc.com>


Re: Confusion in website update

Posted by Justin Mason <jm...@jmason.org>.
btw, now that the ASF have a CMS system, it may be worth investigating
a "port" to that away from webmake -- the problem with the latter is
that it's hard to get a stable foundation to build it on, and an
officially-supported CMS would avoid that.

--j.

On Tue, Jun 21, 2011 at 03:43, Kevin A. McGrail <KM...@pccc.com> wrote:
> On 6/20/2011 9:46 PM, Kevin A. McGrail wrote:
>
> Will fix. They updated ssl I think.
> Regards,
> KAM
>
> "Warren Togami Jr." <wt...@gmail.com> wrote:
>>
>> I tried the perl in your homedir on people, and it seems to be broken
>> because libraries you linked to back in 2009 (or earlier?) have changed
>> on the underling server.
>
> Try the perl in /home/kmcgrail/usr/local/bin
>
> That's now 5.14.0 with all the prereqs for Mail::SpamAssassin as well as
> WebMake 2.4 + prereqs.
>
> Regards,
> KAM
>
>
>

Re: Confusion in website update

Posted by "Kevin A. McGrail" <KM...@PCCC.com>.
On 6/20/2011 9:46 PM, Kevin A. McGrail wrote:
> Will fix. They updated ssl I think.
> Regards,
> KAM
>
> "Warren Togami Jr." <wt...@gmail.com> wrote:
>
>     I tried the perl in your homedir on people, and it seems to be broken
>     because libraries you linked to back in 2009 (or earlier?) have changed
>     on the underling server.
>
Try the perl in /home/kmcgrail/usr/local/bin

That's now 5.14.0 with all the prereqs for Mail::SpamAssassin as well as 
WebMake 2.4 + prereqs.

Regards,
KAM



Re: Confusion in website update

Posted by "Kevin A. McGrail" <KM...@PCCC.com>.
Will fix. They updated ssl I think.
Regards,
KAM

"Warren Togami Jr." <wt...@gmail.com> wrote:

I tried the perl in your homedir on people, and it seems to be broken 
because libraries you linked to back in 2009 (or earlier?) have changed 
on the underling server.

Warren

On 6/17/2011 3:29 PM, Kevin A. McGrail wrote:
> I think that module became required recently with SA. Like JM, I just
> compile my own perl on minotaur and maintain it. Easier that way but I
> remember getting webmake to work was fun :-)
>
> It stinks having to spend an hour(s) doing things you can fix in minutes
> with root. But the ASF has helped in many many other ways.
> Regards,
> KAM
>
> "Warren Togami Jr." <wt...@gmail.com> wrote:
>
> On 06/17/2011 04:13 AM, Kevin A. McGrail wrote:
> > I've run most of this before and gotten webmake to work in my own perl
> > instance if you need help. It runs on minotaur/people.
>
> # build/update_website_docs
> ...
> REQUIRED module missing: NetAddr::IP
> optional module missing: Mail::SPF
> optional module missing: IP::Country
> optional module missing: Razor2
> optional module missing: Net::Ident
> optional module missing: Mail::DKIM
> optional module missing: DBI
> optional module missing: Encode::Detect
>
> warning: some functionality may not be available,
> please read the above report before continuing!
>
> make: no target to make.
> make: don't know how to make text_html_doc. Stop
>
> Warren


Re: Confusion in website update

Posted by "Warren Togami Jr." <wt...@gmail.com>.
I tried the perl in your homedir on people, and it seems to be broken 
because libraries you linked to back in 2009 (or earlier?) have changed 
on the underling server.

Warren

On 6/17/2011 3:29 PM, Kevin A. McGrail wrote:
> I think that module became required recently with SA. Like JM, I just
> compile my own perl on minotaur and maintain it. Easier that way but I
> remember getting webmake to work was fun :-)
>
> It stinks having to spend an hour(s) doing things you can fix in minutes
> with root. But the ASF has helped in many many other ways.
> Regards,
> KAM
>
> "Warren Togami Jr." <wt...@gmail.com> wrote:
>
>     On 06/17/2011 04:13 AM, Kevin A. McGrail wrote:
>     >  I've run most of this before and gotten webmake to work in my own perl
>     >  instance if you need help. It runs on minotaur/people.
>
>     # build/update_website_docs
>     ...
>     REQUIRED module missing: NetAddr::IP
>     optional module missing: Mail::SPF
>     optional module missing: IP::Country
>     optional module missing: Razor2
>     optional module missing: Net::Ident
>     optional module missing: Mail::DKIM
>     optional module missing: DBI
>     optional module missing: Encode::Detect
>
>     warning: some functionality may not be available,
>     please read the above report before continuing!
>
>     make: no target to make.
>     make: don't know how to make text_html_doc. Stop
>
>     Warren


Re: Confusion in website update

Posted by "Kevin A. McGrail" <KM...@PCCC.com>.
I think that module became required recently with SA. Like JM, I just compile my own perl on minotaur and maintain it. Easier that way but I remember getting webmake to work was fun :-) 

It stinks having to spend an hour(s) doing things you can fix in minutes with root. But the ASF has helped in many many other ways.
Regards,
KAM

"Warren Togami Jr." <wt...@gmail.com> wrote:

On 06/17/2011 04:13 AM, Kevin A. McGrail wrote:
> I've run most of this before and gotten webmake to work in my own perl
> instance if you need help. It runs on minotaur/people.

# build/update_website_docs
...
REQUIRED module missing: NetAddr::IP
optional module missing: Mail::SPF
optional module missing: IP::Country
optional module missing: Razor2
optional module missing: Net::Ident
optional module missing: Mail::DKIM
optional module missing: DBI
optional module missing: Encode::Detect

warning: some functionality may not be available,
please read the above report before continuing!

make: no target to make.
make: don't know how to make text_html_doc. Stop

Warren


Re: Confusion in website update

Posted by "Warren Togami Jr." <wt...@gmail.com>.
On 6/17/2011 1:15 PM, Warren Togami Jr. wrote:
> On 06/17/2011 04:13 AM, Kevin A. McGrail wrote:
>> I've run most of this before and gotten webmake to work in my own perl
>> instance if you need help. It runs on minotaur/people.
>
> # build/update_website_docs
> ...
> REQUIRED module missing: NetAddr::IP

Why has NetAddr::IP become an issue in various parts of ASF 
infrastructure only recently?

Warren

Re: Confusion in website update

Posted by "Warren Togami Jr." <wt...@gmail.com>.
On 06/17/2011 04:13 AM, Kevin A. McGrail wrote:
> I've run most of this before and gotten webmake to work in my own perl
> instance if you need help. It runs on minotaur/people.

# build/update_website_docs
...
REQUIRED module missing: NetAddr::IP
optional module missing: Mail::SPF
optional module missing: IP::Country
optional module missing: Razor2
optional module missing: Net::Ident
optional module missing: Mail::DKIM
optional module missing: DBI
optional module missing: Encode::Detect

warning: some functionality may not be available,
please read the above report before continuing!

make: no target to make.
make: don't know how to make text_html_doc. Stop

Warren

Re: Confusion in website update

Posted by "Kevin A. McGrail" <KM...@PCCC.com>.
I've run most of this before and gotten webmake to work in my own perl 
instance if you need help.  It runs on minotaur/people.

Regards,
KAM

On 6/16/2011 11:01 PM, Warren Togami Jr. wrote:
>> - update the 'doc' tree in the SpamAssassin website (WARNING: if you're
>>   moving to a new major release, x.y.0, you need to edit
>>   'build/update_website_docs' beforehand and set the "vers" line):
>>
>>         cd /var/www/buildbot.spamassassin.org/staging/website
>>         svn up
>>         svn delete --force full/3.3.x
>>         svn commit -m "removing old doc tree from website" full
>
> Not sure what this did...
>
>>
>>         cd [checkedoutdir]
>>         build/update_website_docs
>
> Has anyone other than jm ever run this?  It isn't clear what host this 
> is supposed to be run upon.  zones like the previous step?
>
> I made two modifications in an attempt to make it work as documented:
> * ln -s /export/home/wtogami/sabuildtools/bin/perl 
> /export/home/wtogami/spamassassin-3.3/perl
> * Added /var to the beginning of the path...
>
> bash-3.00$ pwd
> /export/home/wtogami/spamassassin-3.3
> bash-3.00$ hostname
> spamassassin.zones.apache.org
> bash-3.00$ pwd
> /export/home/wtogami/spamassassin-3.3
> bash-3.00$ svn up
> At revision 1136754.
> bash-3.00$ ls -l perl
> lrwxrwxrwx   1 wtogami  other         42 Jun 17 01:58 perl -> 
> /export/home/wtogami/sabuildtools/bin/perl
> bash-3.00$ svn diff
> Index: build/update_website_docs
> ===================================================================
> --- build/update_website_docs   (revision 1136754)
> +++ build/update_website_docs   (working copy)
> @@ -1,6 +1,6 @@
>  #!/bin/sh
>
> -WEBDIR=/www/spamassassin.apache.org
> +WEBDIR=/var/www/spamassassin.apache.org
>  vers=3.3.x
>
>  if [ -z "$PERL" ]; then
>
> Then the script completes but with error messages like the following 
> because /var/www/spamassassin.apache.org is entirely absent on this host.
>
> mkdir: Failed to make directory 
> "/var/www/spamassassin.apache.org/full/3.3.x"; No such file or directory
> build/update_website_docs: 
> /var/www/spamassassin.apache.org/full/3.3.x: does not exist
> tar: --exclude=.#*chmod: : No such file or directory
> WARNING: can't access /var/www/spamassassin.apache.org/full/3.3.x
>
>
>>
>>         cd /var/www/buildbot.spamassassin.org/staging/website
>>         svn add full/3.3.x
>>         svn commit -m "updating new doc tree on website" full
>
> Didn't get this far...
>
> Warren


-- 
*Kevin A. McGrail*
President

Peregrine Computer Consulting Corporation
3927 Old Lee Highway, Suite 102-C
Fairfax, VA 22030-2422

http://www.pccc.com/

703-359-9700 x50 / 800-823-8402 (Toll-Free)
703-359-8451 (fax)
KMcGrail@PCCC.com <ma...@pccc.com>


Re: Confusion in website update

Posted by "Daryl C. W. O'Shea" <sp...@dostech.ca>.
On 16/06/2011 11:01 PM, Warren Togami Jr. wrote:
> Has anyone other than jm ever run this? It isn't clear what host this is
> supposed to be run upon. zones like the previous step?

people.apache.org.

Daryl