You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Thejas M Nair (JIRA)" <ji...@apache.org> on 2011/04/05 20:39:05 UTC

[jira] [Created] (PIG-1964) PigStorageSchema fails if a column value is null

PigStorageSchema fails if a column value is null
------------------------------------------------

                 Key: PIG-1964
                 URL: https://issues.apache.org/jira/browse/PIG-1964
             Project: Pig
          Issue Type: Bug
    Affects Versions: 0.8.0, 0.9.0
            Reporter: Thejas M Nair
            Assignee: Thejas M Nair
             Fix For: 0.9.0, 0.8.0


If the data being loaded by PigStorageSchema has a column with null value, the pig query fails with a NullPointerException.

The issue is currently seen in 0.8 branch in svn, not in the 0.8 apache release.


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-1964) PigStorageSchema fails if a column value is null

Posted by "Thejas M Nair (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thejas M Nair updated PIG-1964:
-------------------------------

    Attachment: PIG-1964.1.patch

PIG-1964.1.patch - patch with testcase.

> PigStorageSchema fails if a column value is null
> ------------------------------------------------
>
>                 Key: PIG-1964
>                 URL: https://issues.apache.org/jira/browse/PIG-1964
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.8.0, 0.9.0
>            Reporter: Thejas M Nair
>            Assignee: Thejas M Nair
>             Fix For: 0.8.0, 0.9.0
>
>         Attachments: PIG-1964.0.patch, PIG-1964.1.patch
>
>
> If the data being loaded by PigStorageSchema has a column with null value, the pig query fails with a NullPointerException.
> The issue is currently seen in 0.8 branch in svn, not in the 0.8 apache release.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (PIG-1964) PigStorageSchema fails if a column value is null

Posted by "Thejas M Nair (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13016070#comment-13016070 ] 

Thejas M Nair commented on PIG-1964:
------------------------------------

This bug is related to the change in PIG-1830.

{code}
grunt> cat students2.pigstore
datestamp       vtestid total
{"fields":[{"name":"datestamp","type":55,"description":"autogenerated from Pig Field Schema","schema":null},{"name":"vtestid","type":55,"description":"autogenerated from Pig Field Schema","schema":null},{"name":"total","type":15,"description":"autogenerated from Pig Field Schema","schema":null}],"version":0,"sortKeys":[],"sortKeyOrders":[]}alice   F       1
bob     M       2
carol   F       3
doug            1
ivan    M       3
jill    F       1
grunt>
grunt> l = load 'students2.pigstore' using  org.apache.pig.piggybank.storage.PigStorageSchema();
grunt> dump l;
...
...
java.lang.NullPointerException
        at org.apache.pig.piggybank.storage.PigStorageSchema.getNext(PigStorageSchema.java:95)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader.nextKeyValue(PigRecordReader.java:187)
        at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:423)
        at org.apache.hadoop.mapreduce.MapContext.nextKeyValue(MapContext.java:67)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
        at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)


{code}



> PigStorageSchema fails if a column value is null
> ------------------------------------------------
>
>                 Key: PIG-1964
>                 URL: https://issues.apache.org/jira/browse/PIG-1964
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.8.0, 0.9.0
>            Reporter: Thejas M Nair
>            Assignee: Thejas M Nair
>             Fix For: 0.8.0, 0.9.0
>
>
> If the data being loaded by PigStorageSchema has a column with null value, the pig query fails with a NullPointerException.
> The issue is currently seen in 0.8 branch in svn, not in the 0.8 apache release.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (PIG-1964) PigStorageSchema fails if a column value is null

Posted by "Dmitriy V. Ryaboy (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13016157#comment-13016157 ] 

Dmitriy V. Ryaboy commented on PIG-1964:
----------------------------------------

+1

> PigStorageSchema fails if a column value is null
> ------------------------------------------------
>
>                 Key: PIG-1964
>                 URL: https://issues.apache.org/jira/browse/PIG-1964
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.8.0, 0.9.0
>            Reporter: Thejas M Nair
>            Assignee: Thejas M Nair
>             Fix For: 0.8.0, 0.9.0
>
>         Attachments: PIG-1964.0.patch, PIG-1964.1.patch
>
>
> If the data being loaded by PigStorageSchema has a column with null value, the pig query fails with a NullPointerException.
> The issue is currently seen in 0.8 branch in svn, not in the 0.8 apache release.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (PIG-1964) PigStorageSchema fails if a column value is null

Posted by "Thejas M Nair (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thejas M Nair resolved PIG-1964.
--------------------------------

      Resolution: Fixed
    Hadoop Flags: [Reviewed]

piggybank unit tests and test-patch passed. Patch committed to trunk and 0.8 branch.


> PigStorageSchema fails if a column value is null
> ------------------------------------------------
>
>                 Key: PIG-1964
>                 URL: https://issues.apache.org/jira/browse/PIG-1964
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.8.0, 0.9.0
>            Reporter: Thejas M Nair
>            Assignee: Thejas M Nair
>             Fix For: 0.9.0, 0.8.0
>
>         Attachments: PIG-1964.0.patch, PIG-1964.1.patch
>
>
> If the data being loaded by PigStorageSchema has a column with null value, the pig query fails with a NullPointerException.
> The issue is currently seen in 0.8 branch in svn, not in the 0.8 apache release.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (PIG-1964) PigStorageSchema fails if a column value is null

Posted by "Thejas M Nair (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thejas M Nair updated PIG-1964:
-------------------------------

    Attachment: PIG-1964.0.patch

PIG-1964.0.patch - initial patch, need to add unit test.


> PigStorageSchema fails if a column value is null
> ------------------------------------------------
>
>                 Key: PIG-1964
>                 URL: https://issues.apache.org/jira/browse/PIG-1964
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.8.0, 0.9.0
>            Reporter: Thejas M Nair
>            Assignee: Thejas M Nair
>             Fix For: 0.8.0, 0.9.0
>
>         Attachments: PIG-1964.0.patch
>
>
> If the data being loaded by PigStorageSchema has a column with null value, the pig query fails with a NullPointerException.
> The issue is currently seen in 0.8 branch in svn, not in the 0.8 apache release.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira