[jira] [Created] (HIVE-4758) NULLs and record separators broken with vectorization branch intermediate outputs

["Gopal V (JIRA)" <ji...@apache.org>]

Gopal V created HIVE-4758:
-----------------------------

             Summary: NULLs and record separators broken with vectorization branch intermediate outputs
                 Key: HIVE-4758
                 URL: https://issues.apache.org/jira/browse/HIVE-4758
             Project: Hive
          Issue Type: Bug
          Components: Query Processor
    Affects Versions: vectorization-branch
            Reporter: Gopal V
            Assignee: Gopal V


Queries of type timestamp on partitioned tables return NULL for all rows of timestamp columns, if the first row in the column is NULL.

This was tracked down to the failure of timestamp columns to parse the map output properly, which was due to differing format from the unvectorized code's output.

The output file for vectorized code says 

{code}
(null)^A
2013-02-12 21:05:29^A
{code}

Where the unvectorized code outputs

{code}
\N
2013-02-12 21:05:29
{code}

The vectorized code passes on the "(null)" string to the LazyTimestamp parser, which fails to parse it & returns "NULL", but slowed down massively by the IllegalArgumentException.

And the extraneous ^A prevents the actual Timestamp from being parsed into valid timestamps.






--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira