[jira] [Created] (PIG-4758) In PigStorage when Using -tagPath or -tagFile Option columns order out of sync

["xplenty (JIRA)" <ji...@apache.org>]

xplenty created PIG-4758:
----------------------------

             Summary: In PigStorage when Using -tagPath or -tagFile Option columns order out of sync
                 Key: PIG-4758
                 URL: https://issues.apache.org/jira/browse/PIG-4758
             Project: Pig
          Issue Type: Bug
          Components: internal-udfs, piggybank
    Affects Versions: 0.15.0, 0.14.0
            Reporter: xplenty


when using the following script: 

{code:borderStyle=solid}
a= LOAD 'data.csv' USING PigStorage('\t','-tagPath') AS (filepath:chararray, f1:chararray, f2:chararray); 
b = FOREACH a GENERATE filepath, f2; 
dump b; 
{code}

The output will contain the data from _filepath_ and from _f1_ fields instead of _f2_ field. 
This is caused because of a bug within PigStorage (it also happens in CSVExcelStorage) where it doesn't take the tagPath/tagFile into account when calculating _requiredColumns_ index:

{code:title=PigStorage.java|borderStyle=solid}
if (mRequiredColumns==null || (mRequiredColumns.length>fieldID && mRequiredColumns[fieldID])) 
	addTupleValue(mProtoTuple, buf, start, i); 
{code}

but _fieldID_ doesn't take the tagFile/tagPath column into account.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)