You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@spamassassin.apache.org by Mark London <mr...@psfc.mit.edu> on 2024/06/24 21:18:11 UTC

ChatGPT > Spamassassin? :)

I received a spam email with the text below, that wasn't caught by 
Spamassasin (at least mine).   The text actually looks like something 
that was generated using ChatGPT.  In any event,  I put the text through 
ChatGPT, and asked if it looked like spam.  At the bottom of this email 
, is it's analysis.  I've not been fully reading this group.  Has there 
been any work to allow Spamassassin to use AI?  Thanks.  - Mark

-------------------------------------------------------------------------------------------------------------------------------------------------------------

*From: *Jeff Rothschild <hello@email.bing.com <ma...@email.bing.com>>
*Subject: **From a dreamer!*
*Date: *June 22, 2024 at 18:50:03 EDT
*To: *YOU <hello@email.bing.com <ma...@email.bing.com>>
*Reply-To: *orangebluemoon@naver.com <ma...@naver.com>

Dear Friend,

I hope this letter finds you well, surrounded by the warmth of loved 
ones and the promise of a new day. My name is Jeff Rothschild, and I am 
writing to you today with a heart full of excitement and a vision for a 
different kind of philanthropy.

Below is a profile of me:
www.forbes.com/profile/jeff-rothschild/?sh=457d14d2c87a 
<http://www.forbes.com/profile/jeff-rothschild/?sh=457d14d2c87a>

For many years, I have dedicated myself to supporting various charities 
and causes that are dear to my heart. While I am proud of the impact we 
have made together, I have come to realize that there is more to giving 
than simply writing a check.

Recently, I had a dream—a vivid, inspiring dream that left me with a 
sense of clarity and purpose. In that dream, I saw the faces of ordinary 
people like you and me, each with their own hopes, dreams, and 
struggles. And in that moment, I knew that I needed to be more personal 
with my giving, to touch lives in a way that has never been done before.

That is why I am reaching out to you today, not as a distant benefactor, 
but as a fellow traveler on this journey we call life. I want to invite 
you to be a part of something truly special, something that goes beyond 
traditional philanthropy and connects us on a deeper, more personal level.

Consider this letter your golden ticket to a brighter future. You've 
been selected as the recipient of a generous donation from me., This is 
my appreciation for your presence in this world. But this gift is more 
than just a material offering; it is an invitation to join me in a 
shared mission of compassion, empathy, and human connection.

Together, we can make a difference in the lives of ordinary people in 
ways that are both meaningful and profound. Whether it's lending a 
listening ear to a friend in need, offering a helping hand to a neighbor 
facing adversity, or simply sharing a smile with a stranger, every act 
of kindness has the power to create ripple effects of love and positivity.

So please, accept this gift with an open heart and know that it comes 
with no expectations or obligations. Consider it a gesture of 
friendship, a symbol of our shared humanity, and a catalyst for the 
extraordinary things we can achieve when we come together with purpose 
and passion.

Kindly provide your full name and address, and I will guide you on how 
to receive this donation..

Thank you for being a part of this journey with me. May our shared 
vision of a kinder, more compassionate world inspire us to take bold 
action and spread love wherever we go.

With warmest regards,

Jeff Rothschild

------------------------------------------------------------------------------------------------------------------

The email you received raises several red flags that suggest it might be 
spam or a phishing attempt. Here are key indicators:

 1.

    *Unexpected Generosity*: Receiving an unsolicited offer of money
    from a stranger, especially someone claiming to be a well-known
    philanthropist, is highly unusual and a common tactic in scams.

 2.

    *Emotional Appeal*: The email uses a highly emotional and
    inspirational tone, which is often employed to lower the recipient's
    guard and elicit a positive response.

 3.

    *Request for Personal Information*: The email asks for your full
    name and address, which can be used for identity theft or other
    malicious purposes.

 4.

    *Generic Greeting*: The email addresses you as "Dear Friend" rather
    than using your name, indicating it could be sent to a large number
    of recipients.

 5.

    *Vague and Grandiose Claims*: The email makes grand claims about
    personal philanthropy without providing specific details or a clear
    rationale for why you were chosen.

 6.

    *Suspicious Link*: While the email includes a link to a legitimate
    profile on Forbes, this could be a tactic to add credibility to the
    scam. Scammers often use real profiles to appear legitimate, but
    this doesn't verify the authenticity of the email.

 7.

    *No Verification Method*: There's no way to independently verify the
    sender’s identity or the legitimacy of the offer within the email itself



Re: ChatGPT > Spamassassin? :)

Posted by ja...@mxroute.com.
I'm very interested in the concept. I imagine you'd need to have a 
locally running LLM rather than using an API, both for concerns of 
privacy and performance. Even if not SpamAssassin, I'd love to find 
anyone's open source implementation of AI for spam filtering.

On 2024-06-24 16:18, Mark London wrote:
> I received a spam email with the text below, that wasn't caught by
> Spamassasin (at least mine).   The text actually looks like something
> that was generated using ChatGPT.  In any event,  I put the text
> through ChatGPT, and asked if it looked like spam.  At the bottom of
> this email , is it's analysis.  I've not been fully reading this
> group.  Has there been any work to allow Spamassassin to use AI?
> Thanks.  - Mark
> 
> -------------------------------------------------------------------------------------------------------------------------------------------------------------
> 
> From: Jeff Rothschild <he...@email.bing.com>
> 
> Subject: From a dreamer!
> 
> Date: June 22, 2024 at 18:50:03 EDT
> 
> To: YOU <he...@email.bing.com>
>  Reply-To: orangebluemoon@naver.com
> 
> Dear Friend,
> 
> I hope this letter finds you well, surrounded by the warmth of loved
> ones and the promise of a new day. My name is Jeff Rothschild, and I
> am writing to you today with a heart full of excitement and a vision
> for a different kind of philanthropy.
> 
> Below is a profile of me:
> www.forbes.com/profile/jeff-rothschild/?sh=457d14d2c87a [1]
> 
> For many years, I have dedicated myself to supporting various
> charities and causes that are dear to my heart. While I am proud of
> the impact we have made together, I have come to realize that there is
> more to giving than simply writing a check.
> 
> Recently, I had a dream—a vivid, inspiring dream that left me with a
> sense of clarity and purpose. In that dream, I saw the faces of
> ordinary people like you and me, each with their own hopes, dreams,
> and struggles. And in that moment, I knew that I needed to be more
> personal with my giving, to touch lives in a way that has never been
> done before.
> 
> That is why I am reaching out to you today, not as a distant
> benefactor, but as a fellow traveler on this journey we call life. I
> want to invite you to be a part of something truly special, something
> that goes beyond traditional philanthropy and connects us on a deeper,
> more personal level.
> 
> Consider this letter your golden ticket to a brighter future. You've
> been selected as the recipient of a generous donation from me., This
> is my appreciation for your presence in this world. But this gift is
> more than just a material offering; it is an invitation to join me in
> a shared mission of compassion, empathy, and human connection.
> 
> Together, we can make a difference in the lives of ordinary people in
> ways that are both meaningful and profound. Whether it's lending a
> listening ear to a friend in need, offering a helping hand to a
> neighbor facing adversity, or simply sharing a smile with a stranger,
> every act of kindness has the power to create ripple effects of love
> and positivity.
> 
> So please, accept this gift with an open heart and know that it comes
> with no expectations or obligations. Consider it a gesture of
> friendship, a symbol of our shared humanity, and a catalyst for the
> extraordinary things we can achieve when we come together with purpose
> and passion.
> 
> Kindly provide your full name and address, and I will guide you on how
> to receive this donation..
> 
> Thank you for being a part of this journey with me. May our shared
> vision of a kinder, more compassionate world inspire us to take bold
> action and spread love wherever we go.
> 
> With warmest regards,
> 
> Jeff Rothschild
> 
> ------------------------------------------------------------------------------------------------------------------
> 
> The email you received raises several red flags that suggest it might
> be spam or a phishing attempt. Here are key indicators:
> 
> 	*
> 
> Unexpected Generosity: Receiving an unsolicited offer of money from a
> stranger, especially someone claiming to be a well-known
> philanthropist, is highly unusual and a common tactic in scams.
> 	*
> 
> Emotional Appeal: The email uses a highly emotional and inspirational
> tone, which is often employed to lower the recipient's guard and
> elicit a positive response.
> 	*
> 
> Request for Personal Information: The email asks for your full name
> and address, which can be used for identity theft or other malicious
> purposes.
> 	*
> 
> Generic Greeting: The email addresses you as "Dear Friend" rather than
> using your name, indicating it could be sent to a large number of
> recipients.
> 	*
> 
> Vague and Grandiose Claims: The email makes grand claims about
> personal philanthropy without providing specific details or a clear
> rationale for why you were chosen.
> 	*
> 
> Suspicious Link: While the email includes a link to a legitimate
> profile on Forbes, this could be a tactic to add credibility to the
> scam. Scammers often use real profiles to appear legitimate, but this
> doesn't verify the authenticity of the email.
> 	*
> 
> No Verification Method: There's no way to independently verify the
> sender’s identity or the legitimacy of the offer within the email
> itself
> 
> 
> 
> Links:
> ------
> [1] http://www.forbes.com/profile/jeff-rothschild/?sh=457d14d2c87a

Re: ChatGPT > Spamassassin? :)

Posted by Marcin Mirosław <ma...@mejor.pl>.
W dniu 2024-06-25 15:55, John Hardin napisał(a):
> On Mon, 24 Jun 2024, Mark London wrote:
> 
>> I received a spam email with the text below, that wasn't caught by 
>> Spamassasin (at least mine).   The text actually looks like something 
>> that was generated using ChatGPT.  In any event,  I put the text 
>> through ChatGPT, and asked if it looked like spam.  At the bottom of 
>> this email , is it's analysis.  I've not been fully reading this 
>> group.  Has there been any work to allow Spamassassin to use AI?  
>> Thanks.  - Mark
> 
> In a very limited manner. There is code in the repo that allows you to 
> set up ham and spam corpora and scan the spam corpora to pick out 
> common phrases and filter them via the ham corpora, then create 
> rules.based on the phrases and (IIRC) combinations of them.
> 
> This was being used to generate dynamic fraud rulesets (the "sought" 
> rules, still somewhat there as ADVANCE_FEE rules which I occasionally 
> manually update) until Justin Mason left the project. It's been 
> languishing since as he was providing the resources (infra and 
> maintenance) to run it for those rules. I was feeding those corpora for 
> a long time.
> 
> Take a look in the repo at the stuff under:
> 
>   https://svn.apache.org/viewvc/spamassassin/trunk/masses/rule-dev/
> 
>   
> https://svn.apache.org/viewvc/spamassassin/trunk/masses/evolve_metarule/
> 
> I don't know whether the project would be willing to set up infra to 
> revive dynamic advance fee fraud (or more general) rule generation, but 
> it's possible if someone was willing to bring that code up-to-date and 
> figure out what was needed and corpora providers were available.


This code still works, at least for me. I'm using my own corpora.

Re: ChatGPT > Spamassassin? :)

Posted by John Hardin <jh...@impsec.org>.
On Mon, 24 Jun 2024, Mark London wrote:

> I received a spam email with the text below, that wasn't caught by 
> Spamassasin (at least mine).   The text actually looks like something that 
> was generated using ChatGPT.  In any event,  I put the text through ChatGPT, 
> and asked if it looked like spam.  At the bottom of this email , is it's 
> analysis.  I've not been fully reading this group.  Has there been any work 
> to allow Spamassassin to use AI?  Thanks.  - Mark

In a very limited manner. There is code in the repo that allows you to set 
up ham and spam corpora and scan the spam corpora to pick out common 
phrases and filter them via the ham corpora, then create rules.based on 
the phrases and (IIRC) combinations of them.

This was being used to generate dynamic fraud rulesets (the "sought" 
rules, still somewhat there as ADVANCE_FEE rules which I occasionally 
manually update) until Justin Mason left the project. It's been 
languishing since as he was providing the resources (infra and 
maintenance) to run it for those rules. I was feeding those corpora for a 
long time.

Take a look in the repo at the stuff under:

   https://svn.apache.org/viewvc/spamassassin/trunk/masses/rule-dev/

   https://svn.apache.org/viewvc/spamassassin/trunk/masses/evolve_metarule/

I don't know whether the project would be willing to set up infra to 
revive dynamic advance fee fraud (or more general) rule generation, but 
it's possible if someone was willing to bring that code up-to-date and 
figure out what was needed and corpora providers were available.


-- 
  John Hardin KA7OHZ                    http://www.impsec.org/~jhardin/
  jhardin@impsec.org                         pgpk -a jhardin@impsec.org
  key: 0xB8732E79 -- 2D8C 34F4 6411 F507 136C  AF76 D822 E6E6 B873 2E79
-----------------------------------------------------------------------
   Are you a mildly tech-literate politico horrified by the level of
   ignorance demonstrated by lawmakers gearing up to regulate online
   technology they don't even begin to grasp? Cool. Now you have a
   tiny glimpse into a day in the life of a gun owner.   -- Sean Davis
-----------------------------------------------------------------------
  9 days until the 248th anniversary of the Declaration of Independence

Re: ChatGPT > Spamassassin? :)

Posted by Bill Cole <sa...@billmail.scconsult.com>.
On 2024-06-25 at 17:38:28 UTC-0400 (Tue, 25 Jun 2024 17:38:28 -0400)
Mark London <mr...@psfc.mit.edu>
is rumored to have said:

> Bill - Thanks for the response.  As an aside, it would be nice 
> (though impossible?) for a spam filter to be more suspicious of emails 
> coming from a new email address, that is not in my Sent folder or my 
> Inbox. FWIW. - Mark

Matija's mention of AWL/TxRep is correct here. While some people find it 
a nuisance when it makes one FP into an ongoing series, I think it is 
worth enabling for most sites.

However, if you do enable either of those tools, you should have a 
mechanism for  feeding FPs into both a sitewide Bayes DB and into the 
AWL/TxRep DB by using the blocklist/welcomelist options of the 
spamassassin script.



> On 6/25/2024 11:21 AM, Bill Cole wrote:
>> Mark London <mr...@psfc.mit.edu>
>> is rumored to have said:
>>
>>> I received a spam email with the text below, that wasn't caught by 
>>> Spamassasin (at least mine).   The text actually looks like 
>>> something that was generated using ChatGPT.  In any event,  I put 
>>> the text through ChatGPT, and asked if it looked like spam.  At the 
>>> bottom of this email , is it's analysis.  I've not been fully 
>>> reading this group.  Has there been any work to allow Spamassassin 
>>> to use AI?
>>
>> "Artificial intelligence" does not exist. It is a misnomer.
>>
>> Large language models like ChatGPT have a provenance problem. There's 
>> no way to know why exactly the model "says" anything. In a single 
>> paragraph, ChatGPT is capable of making completely and directly 
>> inconsistent assertions. The only way to explain that is that despite 
>> appearances, a request to answer the ham/spasm question generates 
>> text with no semantic connection to the original, but which seems 
>> like an explanation.
>>
>> SpamAssassin's code and rules all come from ASF committers, and the 
>> scores are determined by examining the scan results from contributors 
>> and optimizing them to a threshold of 5.0. Every scan of a message 
>> results in a list of hits against documented rules. The results can 
>> be analyzed and understood.
>>
>> We know that ChatGPT and other LLMs that are publicly available have 
>> been trained on data to which they had no license. There is no way to 
>> remove any particular ingested data. There's no way to know where any 
>> particular LLM will have problems and no way to fix those problems. 
>> This all puts them outside of the boundaries we have as an ASF 
>> project. However, we do have a plugin architecture, so it is possible 
>> for 3rd parties to create a plugin for LLM integration.
>>
>>


-- 
Bill Cole
bill@scconsult.com or billcole@apache.org
(AKA @grumpybozo@toad.social and many *@billmail.scconsult.com 
addresses)
Not Currently Available For Hire

Sv: Re: ChatGPT > Spamassassin? :)

Posted by Anders Gustafsson <An...@pedago.fi>.
That is the way some email clients, say GroupWise does it. There is an option to put all mail from new
receivers in the junk folder for perusal. OTOH should simple graylisting do the same thing. But yes, an option
to deduct points from previously unseen senders would be useful.

-- 
Med vänlig hälsning

Anders Gustafsson, ingenjör
anders.gustafsson@pedago.fi  |  Support +358 18 12060  |  Direkt +358 9 315 45 121  |  Mobil +358 40506 7099

Pedago interaktiv ab, Nygatan 7 B , AX-22100 MARIEHAMN, ÅLAND, FINLAND



>>> Mark London <mr...@psfc.mit.edu> 2024-06-26 00:38 >>>
Bill - Thanks for the response.  As an aside, it would be nice (though 
impossible?) for a spam filter to be more suspicious of emails coming 
from a new email address, that is not in my Sent folder or my Inbox. 
FWIW. - Mark

On 6/25/2024 11:21 AM, Bill Cole wrote:
> Mark London <mr...@psfc.mit.edu>
> is rumored to have said:
>
>> I received a spam email with the text below, that wasn't caught by 
>> Spamassasin (at least mine).   The text actually looks like something 
>> that was generated using ChatGPT.  In any event,  I put the text 
>> through ChatGPT, and asked if it looked like spam.  At the bottom of 
>> this email , is it's analysis.  I've not been fully reading this 
>> group.  Has there been any work to allow Spamassassin to use AI?
>
> "Artificial intelligence" does not exist. It is a misnomer.
>
> Large language models like ChatGPT have a provenance problem. There's 
> no way to know why exactly the model "says" anything. In a single 
> paragraph, ChatGPT is capable of making completely and directly 
> inconsistent assertions. The only way to explain that is that despite 
> appearances, a request to answer the ham/spasm question generates text 
> with no semantic connection to the original, but which seems like an 
> explanation.
>
> SpamAssassin's code and rules all come from ASF committers, and the 
> scores are determined by examining the scan results from contributors 
> and optimizing them to a threshold of 5.0. Every scan of a message 
> results in a list of hits against documented rules. The results can be 
> analyzed and understood.
>
> We know that ChatGPT and other LLMs that are publicly available have 
> been trained on data to which they had no license. There is no way to 
> remove any particular ingested data. There's no way to know where any 
> particular LLM will have problems and no way to fix those problems. 
> This all puts them outside of the boundaries we have as an ASF 
> project. However, we do have a plugin architecture, so it is possible 
> for 3rd parties to create a plugin for LLM integration.
>
>


Re: ChatGPT > Spamassassin? :)

Posted by Matija Nalis <mn...@voyager.hr>.
On Tue, Jun 25, 2024 at 05:38:28PM -0400, Mark London wrote:
> Bill - Thanks for the response.  As an aside, it would be nice (though
> impossible?) for a spam filter to be more suspicious of emails coming from a
> new email address, that is not in my Sent folder or my Inbox. FWIW. - Mark

Something similar is accomplished by TxRep (or to a lesser degree AWL)
Spamassassin plugin.

Ideally you should use it with mailbox learning (spam/ham training), 
see https://cwiki.apache.org/confluence/display/SPAMASSASSIN/TxRep


-- 
Opinions above are GNU-copylefted.

Re: ChatGPT > Spamassassin? :)

Posted by Mark London <mr...@psfc.mit.edu>.
Bill - Thanks for the response.  As an aside, it would be nice (though 
impossible?) for a spam filter to be more suspicious of emails coming 
from a new email address, that is not in my Sent folder or my Inbox. 
FWIW. - Mark

On 6/25/2024 11:21 AM, Bill Cole wrote:
> Mark London <mr...@psfc.mit.edu>
> is rumored to have said:
>
>> I received a spam email with the text below, that wasn't caught by 
>> Spamassasin (at least mine).   The text actually looks like something 
>> that was generated using ChatGPT.  In any event,  I put the text 
>> through ChatGPT, and asked if it looked like spam.  At the bottom of 
>> this email , is it's analysis.  I've not been fully reading this 
>> group.  Has there been any work to allow Spamassassin to use AI?
>
> "Artificial intelligence" does not exist. It is a misnomer.
>
> Large language models like ChatGPT have a provenance problem. There's 
> no way to know why exactly the model "says" anything. In a single 
> paragraph, ChatGPT is capable of making completely and directly 
> inconsistent assertions. The only way to explain that is that despite 
> appearances, a request to answer the ham/spasm question generates text 
> with no semantic connection to the original, but which seems like an 
> explanation.
>
> SpamAssassin's code and rules all come from ASF committers, and the 
> scores are determined by examining the scan results from contributors 
> and optimizing them to a threshold of 5.0. Every scan of a message 
> results in a list of hits against documented rules. The results can be 
> analyzed and understood.
>
> We know that ChatGPT and other LLMs that are publicly available have 
> been trained on data to which they had no license. There is no way to 
> remove any particular ingested data. There's no way to know where any 
> particular LLM will have problems and no way to fix those problems. 
> This all puts them outside of the boundaries we have as an ASF 
> project. However, we do have a plugin architecture, so it is possible 
> for 3rd parties to create a plugin for LLM integration.
>
>


Re: ChatGPT > Spamassassin? :) -- move along, this is not the reply you are looking for.

Posted by Grant Taylor via users <us...@spamassassin.apache.org>.
On 6/25/24 12:21 PM, Adam Bowen wrote:
> I asked a well known chatbot: What would Bill Cole say if he was asked 
> about integrating AI in to spamassassin?

LOL

I needed that laugh.

Thank you Adam.




-- 
Grant. . . .
unix || die


Re: ChatGPT > Spamassassin? :)

Posted by Adam Bowen <ad...@agitate.org.uk>.
On 25/06/2024 16:21, Bill Cole wrote:
> On 2024-06-24 at 17:18:11 UTC-0400 (Mon, 24 Jun 2024 17:18:11 -0400)
> Mark London <mr...@psfc.mit.edu>
> is rumored to have said:
>
>> I received a spam email with the text below, that wasn't caught by 
>> Spamassasin (at least mine).   The text actually looks like something 
>> that was generated using ChatGPT.  In any event,  I put the text 
>> through ChatGPT, and asked if it looked like spam.  At the bottom of 
>> this email , is it's analysis.  I've not been fully reading this 
>> group.  Has there been any work to allow Spamassassin to use AI?
>
> "Artificial intelligence" does not exist. It is a misnomer.
>
> Large language models like ChatGPT have a provenance problem. There's 
> no way to know why exactly the model "says" anything. In a single 
> paragraph, ChatGPT is capable of making completely and directly 
> inconsistent assertions. The only way to explain that is that despite 
> appearances, a request to answer the ham/spasm question generates text 
> with no semantic connection to the original, but which seems like an 
> explanation.
>
> SpamAssassin's code and rules all come from ASF committers, and the 
> scores are determined by examining the scan results from contributors 
> and optimizing them to a threshold of 5.0. Every scan of a message 
> results in a list of hits against documented rules. The results can be 
> analyzed and understood.
>
> We know that ChatGPT and other LLMs that are publicly available have 
> been trained on data to which they had no license. There is no way to 
> remove any particular ingested data. There's no way to know where any 
> particular LLM will have problems and no way to fix those problems. 
> This all puts them outside of the boundaries we have as an ASF 
> project. However, we do have a plugin architecture, so it is possible 
> for 3rd parties to create a plugin for LLM integration.

I asked a well known chatbot: What would Bill Cole say if he was asked 
about integrating AI in to spamassassin?

> Bill Cole, the maintainer of SpamAssassin, is likely to be 
> enthusiastic about the potential of AI to improve spam detection.
>
> Here's what he might say:
>
> * Improved Spam Filtering: AI could be used to analyze spam emails 
> with greater accuracy than traditional rule-based methods. 
> SpamAssassin currently relies on matching email content to predefined 
> rules, but AI could identify spam based on subtler cues like phrasing, 
> sender behavior, and content structure.
>
> * Adapting to Evolving Threats: Spammers constantly develop new 
> tactics to bypass filters. AI can learn and adapt to these evolving 
> threats much faster than manually updating rules.
>
> * Mitigating False Positives: AI could help reduce the number of 
> legitimate emails mistakenly flagged as spam (false positives). This 
> is a major concern for SpamAssassin users.
>
> However, Bill Cole might also mention some challenges:
>
> * Training Data Bias: The effectiveness of AI depends on the quality 
> and balance of training data. Biases in the training data could lead 
> to the AI disproportionately flagging certain types of emails as spam.
> * Transparency and Explainability: It can be difficult to understand 
> how AI systems arrive at their decisions. This lack of transparency 
> could make it hard to debug errors or identify potential biases.
> * Computational Cost: Training and running AI models can require 
> significant computational resources, which might not be feasible for 
> all SpamAssassin users.
>
> Overall, Bill Cole would likely be cautiously optimistic about the 
> potential of AI to improve SpamAssassin. He would acknowledge the 
> potential benefits but also highlight the challenges that need to be 
> addressed.
>
:)

Re: ChatGPT > Spamassassin? :)

Posted by Bill Cole <sa...@billmail.scconsult.com>.
On 2024-06-24 at 17:18:11 UTC-0400 (Mon, 24 Jun 2024 17:18:11 -0400)
Mark London <mr...@psfc.mit.edu>
is rumored to have said:

> I received a spam email with the text below, that wasn't caught by 
> Spamassasin (at least mine).   The text actually looks like something 
> that was generated using ChatGPT.  In any event,  I put the text 
> through ChatGPT, and asked if it looked like spam.  At the bottom of 
> this email , is it's analysis.  I've not been fully reading this 
> group.  Has there been any work to allow Spamassassin to use AI?

"Artificial intelligence" does not exist. It is a misnomer.

Large language models like ChatGPT have a provenance problem. There's no 
way to know why exactly the model "says" anything. In a single 
paragraph, ChatGPT is capable of making completely and directly 
inconsistent assertions. The only way to explain that is that despite 
appearances, a request to answer the ham/spasm question generates text 
with no semantic connection to the original, but which seems like an 
explanation.

SpamAssassin's code and rules all come from ASF committers, and the 
scores are determined by examining the scan results from contributors 
and optimizing them to a threshold of 5.0. Every scan of a message 
results in a list of hits against documented rules. The results can be 
analyzed and understood.

We know that ChatGPT and other LLMs that are publicly available have 
been trained on data to which they had no license. There is no way to 
remove any particular ingested data. There's no way to know where any 
particular LLM will have problems and no way to fix those problems. This 
all puts them outside of the boundaries we have as an ASF project. 
However, we do have a plugin architecture, so it is possible for 3rd 
parties to create a plugin for LLM integration.


-- 
Bill Cole
bill@scconsult.com or billcole@apache.org
(AKA @grumpybozo@toad.social and many *@billmail.scconsult.com 
addresses)
Not Currently Available For Hire