You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Omer Trajman (JIRA)" <ji...@apache.org> on 2009/11/21 17:25:39 UTC
[jira] Created: (MAPREDUCE-1230) Vertica streaming adapter doesn't
handle nulls in all cases
Vertica streaming adapter doesn't handle nulls in all cases
-----------------------------------------------------------
Key: MAPREDUCE-1230
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1230
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 0.21.0
Environment: Hadoop 0.21.0 pre-release and Vertica 3.0+
Reporter: Omer Trajman
Test user reported that Vertica adapter throws an npe when retrieving null values for certain types (binary, numeric both reported). There is no special case handling when serializing nulls.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1230) Vertica streaming adapter
doesn't handle nulls in all cases
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12786163#action_12786163 ]
Hadoop QA commented on MAPREDUCE-1230:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12425750/MAPREDUCE-1230.patch
against trunk revision 887135.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 9 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/165/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/165/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/165/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/165/console
This message is automatically generated.
> Vertica streaming adapter doesn't handle nulls in all cases
> -----------------------------------------------------------
>
> Key: MAPREDUCE-1230
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1230
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Environment: Hadoop 0.21.0 pre-release and Vertica 3.0+
> Reporter: Omer Trajman
> Assignee: Omer Trajman
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-1230.patch
>
>
> Test user reported that Vertica adapter throws an npe when retrieving null values for certain types (binary, numeric both reported). There is no special case handling when serializing nulls.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1230) Vertica streaming adapter doesn't
handle nulls in all cases
Posted by "Omer Trajman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Omer Trajman updated MAPREDUCE-1230:
------------------------------------
Status: Open (was: Patch Available)
> Vertica streaming adapter doesn't handle nulls in all cases
> -----------------------------------------------------------
>
> Key: MAPREDUCE-1230
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1230
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Environment: Hadoop 0.21.0 pre-release and Vertica 3.0+
> Reporter: Omer Trajman
> Assignee: Omer Trajman
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-1230.patch
>
>
> Test user reported that Vertica adapter throws an npe when retrieving null values for certain types (binary, numeric both reported). There is no special case handling when serializing nulls.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1230) Vertica streaming adapter doesn't
handle nulls in all cases
Posted by "Omer Trajman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Omer Trajman updated MAPREDUCE-1230:
------------------------------------
Status: Patch Available (was: Open)
> Vertica streaming adapter doesn't handle nulls in all cases
> -----------------------------------------------------------
>
> Key: MAPREDUCE-1230
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1230
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Environment: Hadoop 0.21.0 pre-release and Vertica 3.0+
> Reporter: Omer Trajman
> Assignee: Omer Trajman
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-1230.patch
>
>
> Test user reported that Vertica adapter throws an npe when retrieving null values for certain types (binary, numeric both reported). There is no special case handling when serializing nulls.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1230) Vertica streaming adapter
doesn't handle nulls in all cases
Posted by "Omer Trajman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12781125#action_12781125 ]
Omer Trajman commented on MAPREDUCE-1230:
-----------------------------------------
Failures appear to be unrelated to this patch. Looks like mumak contrib tests based on the output. I'd appreciate any help if I'm reading this incorrectly.
> Vertica streaming adapter doesn't handle nulls in all cases
> -----------------------------------------------------------
>
> Key: MAPREDUCE-1230
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1230
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Environment: Hadoop 0.21.0 pre-release and Vertica 3.0+
> Reporter: Omer Trajman
> Assignee: Omer Trajman
> Attachments: MAPREDUCE-1230.patch
>
>
> Test user reported that Vertica adapter throws an npe when retrieving null values for certain types (binary, numeric both reported). There is no special case handling when serializing nulls.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1230) Vertica streaming adapter doesn't
handle nulls in all cases
Posted by "Omer Trajman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Omer Trajman updated MAPREDUCE-1230:
------------------------------------
Release Note: Fixes null handling in records returned from VerticaInputFormat
Status: Patch Available (was: Open)
Fixes null handling in records returned from VerticaInputFormat
> Vertica streaming adapter doesn't handle nulls in all cases
> -----------------------------------------------------------
>
> Key: MAPREDUCE-1230
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1230
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Environment: Hadoop 0.21.0 pre-release and Vertica 3.0+
> Reporter: Omer Trajman
> Assignee: Omer Trajman
> Attachments: MAPREDUCE-1230.patch
>
>
> Test user reported that Vertica adapter throws an npe when retrieving null values for certain types (binary, numeric both reported). There is no special case handling when serializing nulls.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1230) Vertica streaming adapter
doesn't handle nulls in all cases
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12781108#action_12781108 ]
Hadoop QA commented on MAPREDUCE-1230:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12425750/MAPREDUCE-1230.patch
against trunk revision 882790.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 9 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/258/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/258/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/258/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/258/console
This message is automatically generated.
> Vertica streaming adapter doesn't handle nulls in all cases
> -----------------------------------------------------------
>
> Key: MAPREDUCE-1230
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1230
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Environment: Hadoop 0.21.0 pre-release and Vertica 3.0+
> Reporter: Omer Trajman
> Assignee: Omer Trajman
> Attachments: MAPREDUCE-1230.patch
>
>
> Test user reported that Vertica adapter throws an npe when retrieving null values for certain types (binary, numeric both reported). There is no special case handling when serializing nulls.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1230) Vertica streaming adapter doesn't
handle nulls in all cases
Posted by "Omer Trajman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Omer Trajman updated MAPREDUCE-1230:
------------------------------------
Status: Open (was: Patch Available)
> Vertica streaming adapter doesn't handle nulls in all cases
> -----------------------------------------------------------
>
> Key: MAPREDUCE-1230
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1230
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Environment: Hadoop 0.21.0 pre-release and Vertica 3.0+
> Reporter: Omer Trajman
> Assignee: Omer Trajman
> Attachments: MAPREDUCE-1230.patch
>
>
> Test user reported that Vertica adapter throws an npe when retrieving null values for certain types (binary, numeric both reported). There is no special case handling when serializing nulls.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1230) Vertica streaming adapter
doesn't handle nulls in all cases
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12785725#action_12785725 ]
Hadoop QA commented on MAPREDUCE-1230:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12425750/MAPREDUCE-1230.patch
against trunk revision 886353.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 9 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/161/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/161/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/161/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/161/console
This message is automatically generated.
> Vertica streaming adapter doesn't handle nulls in all cases
> -----------------------------------------------------------
>
> Key: MAPREDUCE-1230
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1230
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Environment: Hadoop 0.21.0 pre-release and Vertica 3.0+
> Reporter: Omer Trajman
> Assignee: Omer Trajman
> Attachments: MAPREDUCE-1230.patch
>
>
> Test user reported that Vertica adapter throws an npe when retrieving null values for certain types (binary, numeric both reported). There is no special case handling when serializing nulls.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1230) Vertica streaming adapter doesn't
handle nulls in all cases
Posted by "Omer Trajman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Omer Trajman updated MAPREDUCE-1230:
------------------------------------
Status: Patch Available (was: Open)
> Vertica streaming adapter doesn't handle nulls in all cases
> -----------------------------------------------------------
>
> Key: MAPREDUCE-1230
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1230
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Environment: Hadoop 0.21.0 pre-release and Vertica 3.0+
> Reporter: Omer Trajman
> Assignee: Omer Trajman
> Attachments: MAPREDUCE-1230.patch
>
>
> Test user reported that Vertica adapter throws an npe when retrieving null values for certain types (binary, numeric both reported). There is no special case handling when serializing nulls.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1230) Vertica streaming adapter doesn't
handle nulls in all cases
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated MAPREDUCE-1230:
-------------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
+1 Looks reasonable
I committed this. Thanks, Omer!
> Vertica streaming adapter doesn't handle nulls in all cases
> -----------------------------------------------------------
>
> Key: MAPREDUCE-1230
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1230
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Environment: Hadoop 0.21.0 pre-release and Vertica 3.0+
> Reporter: Omer Trajman
> Assignee: Omer Trajman
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-1230.patch
>
>
> Test user reported that Vertica adapter throws an npe when retrieving null values for certain types (binary, numeric both reported). There is no special case handling when serializing nulls.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (MAPREDUCE-1230) Vertica streaming adapter doesn't
handle nulls in all cases
Posted by "Omer Trajman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Omer Trajman reassigned MAPREDUCE-1230:
---------------------------------------
Assignee: Omer Trajman
> Vertica streaming adapter doesn't handle nulls in all cases
> -----------------------------------------------------------
>
> Key: MAPREDUCE-1230
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1230
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Environment: Hadoop 0.21.0 pre-release and Vertica 3.0+
> Reporter: Omer Trajman
> Assignee: Omer Trajman
>
> Test user reported that Vertica adapter throws an npe when retrieving null values for certain types (binary, numeric both reported). There is no special case handling when serializing nulls.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1230) Vertica streaming adapter doesn't
handle nulls in all cases
Posted by "Omer Trajman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Omer Trajman updated MAPREDUCE-1230:
------------------------------------
Attachment: MAPREDUCE-1230.patch
The attached patch includes special case handling for nulls in serde and for streaming. Unit tests added to check for null handling.
Also included necessary fixes for warnings in unit tests for deprecated config params (mapred -> mapreduce) and using new Job.getInstance API.
> Vertica streaming adapter doesn't handle nulls in all cases
> -----------------------------------------------------------
>
> Key: MAPREDUCE-1230
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1230
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Environment: Hadoop 0.21.0 pre-release and Vertica 3.0+
> Reporter: Omer Trajman
> Assignee: Omer Trajman
> Attachments: MAPREDUCE-1230.patch
>
>
> Test user reported that Vertica adapter throws an npe when retrieving null values for certain types (binary, numeric both reported). There is no special case handling when serializing nulls.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1230) Vertica streaming adapter doesn't
handle nulls in all cases
Posted by "Omer Trajman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Omer Trajman updated MAPREDUCE-1230:
------------------------------------
Fix Version/s: 0.21.0
> Vertica streaming adapter doesn't handle nulls in all cases
> -----------------------------------------------------------
>
> Key: MAPREDUCE-1230
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1230
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.21.0
> Environment: Hadoop 0.21.0 pre-release and Vertica 3.0+
> Reporter: Omer Trajman
> Assignee: Omer Trajman
> Fix For: 0.21.0
>
> Attachments: MAPREDUCE-1230.patch
>
>
> Test user reported that Vertica adapter throws an npe when retrieving null values for certain types (binary, numeric both reported). There is no special case handling when serializing nulls.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.