[jira] [Commented] (HIVE-2084) Upgrade datanucleus from 2.0.3 to 2.2.3

["Ning Zhang (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-2084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13014240#comment-13014240 ] 

Ning Zhang commented on HIVE-2084:
----------------------------------

@Carl, one change (at line 49) in package.jdo is to fix a bug that was not exposed by the old datanucleus version. Without the change datanucleus will throw an exception in runtime (FCOMMENT is not a column of COLUMNS table). I guess the old version of datanucleus didn't check MFieldSchema mapping in package.jdo, by only retrieving the columns mentioned in the <embedded> elements. The other changes are to make the legacy mappings to confirm to the current relational schema (e.g., MFieldSchema.FNAME should be mapped to COLUMNS.COLUMN_NAME). They currently does not cause any runtime exceptions, but I guess it's better to fix it proactively if we are sure the relational mapping is wrong. 

> Upgrade datanucleus from 2.0.3 to 2.2.3
> ---------------------------------------
>
>                 Key: HIVE-2084
>                 URL: https://issues.apache.org/jira/browse/HIVE-2084
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Ning Zhang
>            Assignee: Ning Zhang
>         Attachments: HIVE-2084.patch
>
>
> It seems the datanucleus 2.2.3 does a better join in caching. The time it takes to get the same set of partition objects takes about 1/4 of the time it took for the first time. While with 2.0.3, it took almost the same amount of time in the second execution. We should retest the test case mentioned in HIVE-1853, HIVE-1862.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira