[jira] [Created] (PIG-4491) Streaming Python Bytearray Bugs

["Jeremy Karn (JIRA)" <ji...@apache.org>]

Jeremy Karn created PIG-4491:
--------------------------------

             Summary: Streaming Python Bytearray Bugs
                 Key: PIG-4491
                 URL: https://issues.apache.org/jira/browse/PIG-4491
             Project: Pig
          Issue Type: Bug
            Reporter: Jeremy Karn


While using a streaming python udf that returned a byte array we hit a couple of bugs.

The first was: 

{panel}
org.apache.pig.impl.streaming.StreamingUDFException: LINE : UnicodeDecodeError: 'ascii' codec can't decode byte 0xe6 in position 0: ordinal not in range(128)
{panel}

and the second (after fixing the first) was a null pointer exception.

I traced the problem to two issues:

1. In the python controller the output from the udf was being logged as a unicode string which can fail for bytearrays.

2. Newlines in the data at the start of a response weren't being handled properly on the Java side.

I'm attaching a patch w/ tests that fix these two issues.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)