You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Feynman Liang (JIRA)" <ji...@apache.org> on 2015/08/30 01:12:45 UTC
[jira] [Comment Edited] (SPARK-10351) UnsafeRow.getUTF8String
should handle off-heap memory
[ https://issues.apache.org/jira/browse/SPARK-10351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14721286#comment-14721286 ]
Feynman Liang edited comment on SPARK-10351 at 8/29/15 11:12 PM:
-----------------------------------------------------------------
I'm working on a PR to fix this.
[~rxin] is this a bug or actually intended behavior (and I'm just not interpreting correctly)?
was (Author: fliang):
I'm working on a PR to make my use case work.
[~rxin] is this a bug or actually intended behavior (and I'm just not interpreting correctly)?
> UnsafeRow.getUTF8String should handle off-heap memory
> -----------------------------------------------------
>
> Key: SPARK-10351
> URL: https://issues.apache.org/jira/browse/SPARK-10351
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Reporter: Feynman Liang
> Priority: Critical
>
> {{UnsafeRow.getUTF8String}} delegates to {{UTF8String.fromAddress}} which returns {{null}} when passed a {{null}} base object, failing to handle off-heap memory correctly.
> This will also cause a {{NullPointerException}} when {{getString}} is called with off-heap storage.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org