You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Wenchen Fan (Jira)" <ji...@apache.org> on 2020/04/17 04:50:00 UTC
[jira] [Resolved] (SPARK-31425)
UnsafeKVExternalSorter/VariableLengthRowBasedKeyValueBatch should also
respect UnsafeAlignedOffset
[ https://issues.apache.org/jira/browse/SPARK-31425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wenchen Fan resolved SPARK-31425.
---------------------------------
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 28195
[https://github.com/apache/spark/pull/28195]
> UnsafeKVExternalSorter/VariableLengthRowBasedKeyValueBatch should also respect UnsafeAlignedOffset
> --------------------------------------------------------------------------------------------------
>
> Key: SPARK-31425
> URL: https://issues.apache.org/jira/browse/SPARK-31425
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.1.0
> Reporter: wuyi
> Assignee: wuyi
> Priority: Major
> Fix For: 3.0.0
>
>
> Since BytesToBytesMap respects UnsafeAlignedOffset when writing the record, UnsafeKVExternalSorter should also respect UnsafeAlignedOffset when reading the record otherwise it will causes a data correctness issue.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org