You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@allura.apache.org by Dave Brondsema <br...@users.sf.net> on 2014/01/24 19:51:36 UTC

[allura:tickets] #7096 encoding error on smtp_server task handoff



---

** [tickets:#7096] encoding error on smtp_server task handoff**

**Status:** open
**Created:** Fri Jan 24, 2014 06:50 PM UTC by Dave Brondsema
**Last Updated:** Fri Jan 24, 2014 06:50 PM UTC
**Owner:** nobody

Here's the trace, and one of the email headers is `Content-Type: text/plain; charset=ISO-8859-1; format=flowed` and certainly there was some non-utf8 in the mail body.

~~~~
Traceback (most recent call last):
  File "/var/local/allura/Allura/allura/command/smtp_server.py", line 57, in process_message
    peer=peer, mailfrom=mailfrom, rcpttos=rcpttos, data=data)
  File "/var/local/allura/Allura/allura/lib/decorators.py", line 62, in post
    return M.MonQTask.post(func, args, kwargs, delay=delay)
  File "/var/local/allura/Allura/allura/model/monq_model.py", line 173, in post
    session(obj).flush(obj)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/base.py", line 29, in inner
    result = func(obj, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/odmsession.py", line 59, in flush
    self.insert_now(obj, st)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/base.py", line 29, in inner
    result = func(obj, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/odmsession.py", line 67, in insert_now
    mapper(obj).insert(obj, st, self, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/base.py", line 29, in inner
    result = func(obj, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/mapper.py", line 55, in insert
    session.impl.insert(doc, validate=False)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/session.py", line 22, in wrapper
    return func(self, doc, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/session.py", line 160, in insert
    bson = self._impl(doc).insert(data, safe=kwargs.get('safe', True))
  File "/var/local/env-allura/lib/python2.7/site-packages/pymongo-2.4.2-py2.7-linux-x86_64.egg/pymongo/collection.py", line 359, in insert
    continue_on_error, self.__uuid_subtype), safe)
InvalidStringData: ('strings in documents must be valid UTF-8', 'doc: 
~~~~


---

Sent from sourceforge.net because allura-dev@incubator.apache.org is subscribed to https://sourceforge.net/p/allura/tickets/

To unsubscribe from further messages, a project admin can change settings at https://sourceforge.net/p/allura/admin/tickets/options.  Or, if this is a mailing list, you can unsubscribe from the mailing list.

[allura:tickets] #7096 encoding error on smtp_server task handoff

Posted by Tim Van Steenburgh <va...@users.sf.net>.
- **status**: open --> in-progress
- **assigned_to**: Tim Van Steenburgh



---

** [tickets:#7096] encoding error on smtp_server task handoff**

**Status:** in-progress
**Created:** Fri Jan 24, 2014 06:50 PM UTC by Dave Brondsema
**Last Updated:** Fri Jan 24, 2014 07:13 PM UTC
**Owner:** Tim Van Steenburgh

Here's the trace, and one of the email headers is `Content-Type: text/plain; charset=ISO-8859-1; format=flowed` and certainly there was some non-utf8 in the mail body.

~~~~
Traceback (most recent call last):
  File "/var/local/allura/Allura/allura/command/smtp_server.py", line 57, in process_message
    peer=peer, mailfrom=mailfrom, rcpttos=rcpttos, data=data)
  File "/var/local/allura/Allura/allura/lib/decorators.py", line 62, in post
    return M.MonQTask.post(func, args, kwargs, delay=delay)
  File "/var/local/allura/Allura/allura/model/monq_model.py", line 173, in post
    session(obj).flush(obj)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/base.py", line 29, in inner
    result = func(obj, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/odmsession.py", line 59, in flush
    self.insert_now(obj, st)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/base.py", line 29, in inner
    result = func(obj, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/odmsession.py", line 67, in insert_now
    mapper(obj).insert(obj, st, self, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/base.py", line 29, in inner
    result = func(obj, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/mapper.py", line 55, in insert
    session.impl.insert(doc, validate=False)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/session.py", line 22, in wrapper
    return func(self, doc, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/session.py", line 160, in insert
    bson = self._impl(doc).insert(data, safe=kwargs.get('safe', True))
  File "/var/local/env-allura/lib/python2.7/site-packages/pymongo-2.4.2-py2.7-linux-x86_64.egg/pymongo/collection.py", line 359, in insert
    continue_on_error, self.__uuid_subtype), safe)
InvalidStringData: ('strings in documents must be valid UTF-8', 'doc: 
~~~~


---

Sent from sourceforge.net because allura-dev@incubator.apache.org is subscribed to https://sourceforge.net/p/allura/tickets/

To unsubscribe from further messages, a project admin can change settings at https://sourceforge.net/p/allura/admin/tickets/options.  Or, if this is a mailing list, you can unsubscribe from the mailing list.

[allura:tickets] #7096 encoding error on smtp_server task handoff

Posted by Dave Brondsema <br...@users.sf.net>.
- **status**: code-review --> closed
- **QA**: Dave Brondsema



---

** [tickets:#7096] encoding error on smtp_server task handoff**

**Status:** closed
**Created:** Fri Jan 24, 2014 06:50 PM UTC by Dave Brondsema
**Last Updated:** Fri Jan 31, 2014 05:57 PM UTC
**Owner:** Tim Van Steenburgh

Here's the trace, and one of the email headers is `Content-Type: text/plain; charset=ISO-8859-1; format=flowed` and certainly there was some non-utf8 in the mail body.

~~~~
Traceback (most recent call last):
  File "/var/local/allura/Allura/allura/command/smtp_server.py", line 57, in process_message
    peer=peer, mailfrom=mailfrom, rcpttos=rcpttos, data=data)
  File "/var/local/allura/Allura/allura/lib/decorators.py", line 62, in post
    return M.MonQTask.post(func, args, kwargs, delay=delay)
  File "/var/local/allura/Allura/allura/model/monq_model.py", line 173, in post
    session(obj).flush(obj)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/base.py", line 29, in inner
    result = func(obj, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/odmsession.py", line 59, in flush
    self.insert_now(obj, st)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/base.py", line 29, in inner
    result = func(obj, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/odmsession.py", line 67, in insert_now
    mapper(obj).insert(obj, st, self, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/base.py", line 29, in inner
    result = func(obj, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/mapper.py", line 55, in insert
    session.impl.insert(doc, validate=False)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/session.py", line 22, in wrapper
    return func(self, doc, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/session.py", line 160, in insert
    bson = self._impl(doc).insert(data, safe=kwargs.get('safe', True))
  File "/var/local/env-allura/lib/python2.7/site-packages/pymongo-2.4.2-py2.7-linux-x86_64.egg/pymongo/collection.py", line 359, in insert
    continue_on_error, self.__uuid_subtype), safe)
InvalidStringData: ('strings in documents must be valid UTF-8', 'doc: 
~~~~


---

Sent from sourceforge.net because allura-dev@incubator.apache.org is subscribed to https://sourceforge.net/p/allura/tickets/

To unsubscribe from further messages, a project admin can change settings at https://sourceforge.net/p/allura/admin/tickets/options.  Or, if this is a mailing list, you can unsubscribe from the mailing list.

[allura:tickets] #7096 encoding error on smtp_server task handoff

Posted by Dave Brondsema <br...@users.sf.net>.
- **Size**:  --> 1



---

** [tickets:#7096] encoding error on smtp_server task handoff**

**Status:** open
**Created:** Fri Jan 24, 2014 06:50 PM UTC by Dave Brondsema
**Last Updated:** Fri Jan 24, 2014 06:50 PM UTC
**Owner:** nobody

Here's the trace, and one of the email headers is `Content-Type: text/plain; charset=ISO-8859-1; format=flowed` and certainly there was some non-utf8 in the mail body.

~~~~
Traceback (most recent call last):
  File "/var/local/allura/Allura/allura/command/smtp_server.py", line 57, in process_message
    peer=peer, mailfrom=mailfrom, rcpttos=rcpttos, data=data)
  File "/var/local/allura/Allura/allura/lib/decorators.py", line 62, in post
    return M.MonQTask.post(func, args, kwargs, delay=delay)
  File "/var/local/allura/Allura/allura/model/monq_model.py", line 173, in post
    session(obj).flush(obj)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/base.py", line 29, in inner
    result = func(obj, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/odmsession.py", line 59, in flush
    self.insert_now(obj, st)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/base.py", line 29, in inner
    result = func(obj, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/odmsession.py", line 67, in insert_now
    mapper(obj).insert(obj, st, self, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/base.py", line 29, in inner
    result = func(obj, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/mapper.py", line 55, in insert
    session.impl.insert(doc, validate=False)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/session.py", line 22, in wrapper
    return func(self, doc, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/session.py", line 160, in insert
    bson = self._impl(doc).insert(data, safe=kwargs.get('safe', True))
  File "/var/local/env-allura/lib/python2.7/site-packages/pymongo-2.4.2-py2.7-linux-x86_64.egg/pymongo/collection.py", line 359, in insert
    continue_on_error, self.__uuid_subtype), safe)
InvalidStringData: ('strings in documents must be valid UTF-8', 'doc: 
~~~~


---

Sent from sourceforge.net because allura-dev@incubator.apache.org is subscribed to https://sourceforge.net/p/allura/tickets/

To unsubscribe from further messages, a project admin can change settings at https://sourceforge.net/p/allura/admin/tickets/options.  Or, if this is a mailing list, you can unsubscribe from the mailing list.

[allura:tickets] #7096 encoding error on smtp_server task handoff

Posted by Tim Van Steenburgh <va...@users.sf.net>.
allura:tv/7096

To repro on master (tail allura.log to see error):

    yum install swaks
    swaks --server localhost:50088 --to 1@tickets.testproject.p.tvansteenburgh-1024.sb.sf.net --from 'user01@users.sf.net' --body "`printf "\xc3\x28"`"

Apply fix, restart smtp_server, rerun swaks command.


---

** [tickets:#7096] encoding error on smtp_server task handoff**

**Status:** code-review
**Created:** Fri Jan 24, 2014 06:50 PM UTC by Dave Brondsema
**Last Updated:** Fri Jan 31, 2014 04:20 PM UTC
**Owner:** Tim Van Steenburgh

Here's the trace, and one of the email headers is `Content-Type: text/plain; charset=ISO-8859-1; format=flowed` and certainly there was some non-utf8 in the mail body.

~~~~
Traceback (most recent call last):
  File "/var/local/allura/Allura/allura/command/smtp_server.py", line 57, in process_message
    peer=peer, mailfrom=mailfrom, rcpttos=rcpttos, data=data)
  File "/var/local/allura/Allura/allura/lib/decorators.py", line 62, in post
    return M.MonQTask.post(func, args, kwargs, delay=delay)
  File "/var/local/allura/Allura/allura/model/monq_model.py", line 173, in post
    session(obj).flush(obj)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/base.py", line 29, in inner
    result = func(obj, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/odmsession.py", line 59, in flush
    self.insert_now(obj, st)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/base.py", line 29, in inner
    result = func(obj, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/odmsession.py", line 67, in insert_now
    mapper(obj).insert(obj, st, self, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/base.py", line 29, in inner
    result = func(obj, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/mapper.py", line 55, in insert
    session.impl.insert(doc, validate=False)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/session.py", line 22, in wrapper
    return func(self, doc, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/session.py", line 160, in insert
    bson = self._impl(doc).insert(data, safe=kwargs.get('safe', True))
  File "/var/local/env-allura/lib/python2.7/site-packages/pymongo-2.4.2-py2.7-linux-x86_64.egg/pymongo/collection.py", line 359, in insert
    continue_on_error, self.__uuid_subtype), safe)
InvalidStringData: ('strings in documents must be valid UTF-8', 'doc: 
~~~~


---

Sent from sourceforge.net because allura-dev@incubator.apache.org is subscribed to https://sourceforge.net/p/allura/tickets/

To unsubscribe from further messages, a project admin can change settings at https://sourceforge.net/p/allura/admin/tickets/options.  Or, if this is a mailing list, you can unsubscribe from the mailing list.

[allura:tickets] #7096 encoding error on smtp_server task handoff

Posted by Tim Van Steenburgh <va...@users.sf.net>.
- **status**: in-progress --> code-review



---

** [tickets:#7096] encoding error on smtp_server task handoff**

**Status:** code-review
**Created:** Fri Jan 24, 2014 06:50 PM UTC by Dave Brondsema
**Last Updated:** Fri Jan 31, 2014 04:20 PM UTC
**Owner:** Tim Van Steenburgh

Here's the trace, and one of the email headers is `Content-Type: text/plain; charset=ISO-8859-1; format=flowed` and certainly there was some non-utf8 in the mail body.

~~~~
Traceback (most recent call last):
  File "/var/local/allura/Allura/allura/command/smtp_server.py", line 57, in process_message
    peer=peer, mailfrom=mailfrom, rcpttos=rcpttos, data=data)
  File "/var/local/allura/Allura/allura/lib/decorators.py", line 62, in post
    return M.MonQTask.post(func, args, kwargs, delay=delay)
  File "/var/local/allura/Allura/allura/model/monq_model.py", line 173, in post
    session(obj).flush(obj)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/base.py", line 29, in inner
    result = func(obj, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/odmsession.py", line 59, in flush
    self.insert_now(obj, st)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/base.py", line 29, in inner
    result = func(obj, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/odmsession.py", line 67, in insert_now
    mapper(obj).insert(obj, st, self, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/base.py", line 29, in inner
    result = func(obj, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/odm/mapper.py", line 55, in insert
    session.impl.insert(doc, validate=False)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/session.py", line 22, in wrapper
    return func(self, doc, *args, **kwargs)
  File "/var/local/env-allura/lib/python2.7/site-packages/Ming-0.4.2-py2.7.egg/ming/session.py", line 160, in insert
    bson = self._impl(doc).insert(data, safe=kwargs.get('safe', True))
  File "/var/local/env-allura/lib/python2.7/site-packages/pymongo-2.4.2-py2.7-linux-x86_64.egg/pymongo/collection.py", line 359, in insert
    continue_on_error, self.__uuid_subtype), safe)
InvalidStringData: ('strings in documents must be valid UTF-8', 'doc: 
~~~~


---

Sent from sourceforge.net because allura-dev@incubator.apache.org is subscribed to https://sourceforge.net/p/allura/tickets/

To unsubscribe from further messages, a project admin can change settings at https://sourceforge.net/p/allura/admin/tickets/options.  Or, if this is a mailing list, you can unsubscribe from the mailing list.