You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spamassassin.apache.org by bu...@spamassassin.apache.org on 2019/05/31 19:03:46 UTC

[Bug 7717] New: Migrate SpamAssassin project wiki from Moin (wiki.apache.org) to Confluence cwiki

https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7717

            Bug ID: 7717
           Summary: Migrate SpamAssassin project wiki from Moin
                    (wiki.apache.org) to Confluence cwiki
           Product: Spamassassin
           Version: unspecified
          Hardware: All
                OS: All
            Status: NEW
          Severity: major
          Priority: P2
         Component: Website/Infrastructure
          Assignee: dev@spamassassin.apache.org
          Reporter: jhardin@impsec.org
  Target Milestone: Undefined

Migrate the SpamAssassin project wiki from Moin (wiki.apache.org) to Confluence
cwiki.

SA Wiki URL:  https://wiki.apache.org/spamassassin/

Deadline: June 30, 2019

Announcement from Infra:

-----------------------------------------------------
Hi All,

As you may be aware moin wiki service has been deprecated for some time now
- we have not been accepting new moin wikis.

Infra has decided to close down the service, and so all projects that still
have a moin wiki are being asked to migrate away to Confluence. We have set
a deadline of May 31st, 3 months from ncw.

Help is at hand! - Infra has provided a self serve tool to assist (or if
all goes well, complete for you) with migration from moin to confluence.
PMC Chairs can go to selfserve.apache.org and choose the Migrate Moin to
Confluence option, fill in the minimal details and let it do its thing. An
existing Confluence wiki space must exist first - again selfserve.apache.org
and choose Create Confluence wiki can help there too.

The migration isn't 100% in all circumstances. There are always going to be
scenarios where pages don't quite look like the original, feedback is
welcome and we may be able to tweak. But the main idea is , get your pages
into Confluence. Bonus items that we are still working on, in page @mentions,
page creator and last modified etc are currently assigned to the importer
account.

Also available is page history - but this takes a really long time to
import as each conversion, export and and upload step is multiplied by the
number of revisions - so things can take hours, and could introduce other
complications, but you are welcome to have a go.

Any project that wants to help test this now, please do create a ticket and
I'll help all the way through to completion - at this stage we may  be able
to tweak and improve the tool.

Any questions , feel free to reach out to Infra.

Thanks

Gavin (ASF Infra Team)

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 7717] Migrate SpamAssassin project wiki from Moin (wiki.apache.org) to Confluence cwiki

Posted by bu...@spamassassin.apache.org.
https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7717

Sidney Markowitz <si...@sidney.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |sidney@sidney.com

--- Comment #1 from Sidney Markowitz <si...@sidney.com> ---
Migration has been run, with Infra's help with some issues.
The new wiki is at https://cwiki.apache.org/confluence/display/SPAMASSASSIN

Next step is to request Infra to make the old wiki read-only.

Some things I can think of to do off the top of my head, please add anything
else you can think of:

Ask Infra if they can make the old wiki URLs redirect to the same page at the
cwiki, so all old links continue to work.

Change the link to wiki in the top nav bar on our home page at
https://spamassassin.apache.org/

If the old wiki URLs will not redirect to the new one, do something so that
people who go to an old link will see information about the new wiki.

Make an attempt to find and fix pages that contain MoinMoin macros, and
references to them, such as everything to do with CategoryPages.

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 7717] Migrate SpamAssassin project wiki from Moin (wiki.apache.org) to Confluence cwiki

Posted by bu...@spamassassin.apache.org.
https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7717

--- Comment #3 from Sidney Markowitz <si...@sidney.com> ---
https://cwiki.apache.org/confluence/display/SPAMASSASSIN/CollaborativeManual
needs to be rewritten as it is MoinMoin specific

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 7717] Migrate SpamAssassin project wiki from Moin (wiki.apache.org) to Confluence cwiki

Posted by bu...@spamassassin.apache.org.
https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7717

--- Comment #8 from Sidney Markowitz <si...@sidney.com> ---
I've replaced every use of CategoryXXXX that was used to tag a page with the
label XXXX and replaced the use of any more  <<macros>> that I could find.

The last notice I saw from Infra said that they intend to implement redirects
and remove the old MoinMoin wiki completely at the end of the month. That takes
care of any tasks that are related to redirection.

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 7717] Migrate SpamAssassin project wiki from Moin (wiki.apache.org) to Confluence cwiki

Posted by bu...@spamassassin.apache.org.
https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7717

--- Comment #10 from Sidney Markowitz <si...@sidney.com> ---
(In reply to Henrik Krohns from comment #9)
 Perhaps just keep few useful ones like ALL_TRUSTED etc.

Can you put together a list of the ones that you think would be useful? We
could give that list to Infra to see if they could migrate just those, and then
we would be ready for them to shut down the old wiki and enable the
redirection.

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 7717] Migrate SpamAssassin project wiki from Moin (wiki.apache.org) to Confluence cwiki

Posted by bu...@spamassassin.apache.org.
https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7717

--- Comment #6 from Sidney Markowitz <si...@sidney.com> ---
The page CollaborativeManual needs to be rewritten. It is supposed to be an
introduction on how to use the wiki, linked to by the home page and
BetterDocumentation but almost all of the content and links on the page are
specific to MoinMoin.

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 7717] Migrate SpamAssassin project wiki from Moin (wiki.apache.org) to Confluence cwiki

Posted by bu...@spamassassin.apache.org.
https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7717

--- Comment #13 from Henrik Krohns <ap...@hege.li> ---
PS. I wget mirrored the old wiki, so there's atleast one copy around..

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 7717] Migrate SpamAssassin project wiki from Moin (wiki.apache.org) to Confluence cwiki

Posted by bu...@spamassassin.apache.org.
https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7717

--- Comment #2 from Sidney Markowitz <si...@sidney.com> ---
Steps to fix up the Category pages

See list of all categories at
https://wiki.apache.org/spamassassin/CategoryCategory

For each CategoryFoo
 delete the cwiki page named CategoryFoo
 On the cwiki search for CategoryFoo
   for each page found with "CategoryFoo" on the bottom
      Add a label foo
      Edit the page to delete the CategoryFoo at the bottom of the page

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 7717] Migrate SpamAssassin project wiki from Moin (wiki.apache.org) to Confluence cwiki

Posted by bu...@spamassassin.apache.org.
https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7717

Sidney Markowitz <si...@sidney.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
         Resolution|---                         |FIXED
             Status|NEW                         |RESOLVED

--- Comment #15 from Sidney Markowitz <si...@sidney.com> ---
It's done and I edited the web site so that it will not rely on redirects from
the old URLs. There is an open issue with Infra about redirects not working,
but I don't think that is a reason to keep this issue open.

Closing with this comment.

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 7717] Migrate SpamAssassin project wiki from Moin (wiki.apache.org) to Confluence cwiki

Posted by bu...@spamassassin.apache.org.
https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7717

--- Comment #12 from Henrik Krohns <ap...@hege.li> ---
(In reply to Sidney Markowitz from comment #10)
> (In reply to Henrik Krohns from comment #9)
>  Perhaps just keep few useful ones like ALL_TRUSTED etc.
> 
> Can you put together a list of the ones that you think would be useful? We
> could give that list to Infra to see if they could migrate just those, and
> then we would be ready for them to shut down the old wiki and enable the
> redirection.

Maybe some confusing ones would be

ALL_TRUSTED
NO_RELAYS

Honestly I don't know if it's worth to delay things because of them. I'm sure
we can write all these up again later if needed..

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 7717] Migrate SpamAssassin project wiki from Moin (wiki.apache.org) to Confluence cwiki

Posted by bu...@spamassassin.apache.org.
https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7717

--- Comment #14 from Sidney Markowitz <si...@sidney.com> ---
Ok, time to go for it, then.

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 7717] Migrate SpamAssassin project wiki from Moin (wiki.apache.org) to Confluence cwiki

Posted by bu...@spamassassin.apache.org.
https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7717

Henrik Krohns <ap...@hege.li> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |apache@hege.li

--- Comment #9 from Henrik Krohns <ap...@hege.li> ---
(In reply to Sidney Markowitz from comment #5)
> Does anyone think we can
> do that with our current dynamic rule set? Should we just delete all the
> pages labeled "rules" and the RulesList page?

Perhaps just keep few useful ones like ALL_TRUSTED etc. Seems pointless trying
to document every rule, rather spend that time writing actual rules (preferably
with a short and useful "describe").

If someone really wants to write a script pushing all describes there, why not.
The script has to be intelligent enough to keep any custom long "Explanation"
block if someone modifed it.

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 7717] Migrate SpamAssassin project wiki from Moin (wiki.apache.org) to Confluence cwiki

Posted by bu...@spamassassin.apache.org.
https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7717

--- Comment #5 from Sidney Markowitz <si...@sidney.com> ---
I have made every page with some CategoryFoo instead have a label foo and
deleted the CategoryFoo pages. Any link to a CategoryFoo page should be
replaced with whatever Confluence provides for linking to a list of all pages
with label foo.

The RulesList page doesn't work on the cwiki because it uses MoinMoin macros
FullSearch and NewPage. But that page and all the pages with CategoryRules, now
label rules, no longer make sense to have. They are an attempt to implement bug
#4771 to document rules on the wiki. Does anyone think we can do that with our
current dynamic rule set? Should we just delete all the pages labeled "rules"
and the RulesList page?

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 7717] Migrate SpamAssassin project wiki from Moin (wiki.apache.org) to Confluence cwiki

Posted by bu...@spamassassin.apache.org.
https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7717

--- Comment #4 from Sidney Markowitz <si...@sidney.com> ---
It looks like the search function in Confluence is quite limited. It uses a
Lucene word search engine that tokenizes the text and removes everything from a
list of "stop" words. There is a 10 year old feature request about this on the
Confluence issue tracker that has over 800 votes and is still being ignored. It
means you cannot search for a specific phrase if it contains short common
words, nor can you search for pages with MoinMoin macros by looking for "<<"
and ">>".

The workaround I see is to do the search on the old wiki, and then edit pages
on the cwiki.

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 7717] Migrate SpamAssassin project wiki from Moin (wiki.apache.org) to Confluence cwiki

Posted by bu...@spamassassin.apache.org.
https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7717

Kevin A. McGrail <km...@apache.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |kmcgrail@apache.org

--- Comment #11 from Kevin A. McGrail <km...@apache.org> ---
I'm +0 on dropping the rule description from the wiki

-- 
You are receiving this mail because:
You are the assignee for the bug.

[Bug 7717] Migrate SpamAssassin project wiki from Moin (wiki.apache.org) to Confluence cwiki

Posted by bu...@spamassassin.apache.org.
https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7717

--- Comment #7 from Sidney Markowitz <si...@sidney.com> ---
There appears to have been a bug in the migration that none of the subpages
under Rules were copied over, for example
 https://wiki.apache.org/spamassassin/Rules/BAYES_00

However, should we consider all of those pages that were done for bug #4771
obsolete and not try to maintain pages for them unless we can do something
automat4ed that works off of rule updates?

BTW, sorry for my duplicate post in comment #3 and comment #5

-- 
You are receiving this mail because:
You are the assignee for the bug.