You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Cheolsoo Park (JIRA)" <ji...@apache.org> on 2014/02/08 03:44:19 UTC
[jira] [Updated] (PIG-3456) Reduce threadlocal conf access in
backend for each record
[ https://issues.apache.org/jira/browse/PIG-3456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Cheolsoo Park updated PIG-3456:
-------------------------------
Attachment: PIG-3456-1-no-whitespace.patch
Looks like a good clean-up to me. I am uploading the no-whitespace patch incase someone else wants to take a look at it.
+1 assuming all the tests pass. Thank you Rohini for doing this!
> Reduce threadlocal conf access in backend for each record
> ---------------------------------------------------------
>
> Key: PIG-3456
> URL: https://issues.apache.org/jira/browse/PIG-3456
> Project: Pig
> Issue Type: Improvement
> Affects Versions: 0.11.1
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Fix For: 0.13.0
>
> Attachments: PIG-3456-1-no-whitespace.patch, PIG-3456-1.patch
>
>
> Noticed few things while browsing code
> 1) DefaultTuple has a protected boolean isNull = false; which is never used. Removing this gives ~3-5% improvement for big jobs
> 2) Config checking with ThreadLocal conf is repeatedly done for each record. For eg: createDataBag in POCombinerPackage. But initialized only for first time in other places like POPackage, POJoinPackage, etc.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)