You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Rohini Palaniswamy (JIRA)" <ji...@apache.org> on 2016/02/10 23:52:18 UTC
[jira] [Created] (PIG-4806) UDFContext can be overwritten with
empty properties in the task for inputs and outputs during initialization
Rohini Palaniswamy created PIG-4806:
---------------------------------------
Summary: UDFContext can be overwritten with empty properties in the task for inputs and outputs during initialization
Key: PIG-4806
URL: https://issues.apache.org/jira/browse/PIG-4806
Project: Pig
Issue Type: Bug
Reporter: Rohini Palaniswamy
Assignee: Rohini Palaniswamy
Fix For: 0.16.0
We reinitialize UDFContext ThreadLocal itself in PigProcessor.initialize(). PigProcessor.initialize() is run in parallel with threads that do MRInput.initialize() and MROutput.initialize(). It can overwrite the initialized values in the input and output half way through. This can lead to exceptions if the property stored in UDFContext is mandatory and task will be retried which is ok. If it is not mandatory and it ends up getting null when it actually had a value, wrong data can be produced silently.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)