You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "bettermouse (Jira)" <ji...@apache.org> on 2022/10/21 09:25:00 UTC
[jira] [Updated] (SPARK-18188) Add checksum for block of broadcast
[ https://issues.apache.org/jira/browse/SPARK-18188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
bettermouse updated SPARK-18188:
--------------------------------
Description:
{color:red}着色文本{color}There is an understanding issue for a long time: https://issues.apache.org/jira/browse/SPARK-4105, without any checksum for the blocks, it's very hard for us to identify where is the bug came from.
Shuffle blocks are compressed separate (have checksum in it), but broadcast blocks are compressed together, we should add checksum for each of separately.
was:
There is an understanding issue for a long time: https://issues.apache.org/jira/browse/SPARK-4105, without any checksum for the blocks, it's very hard for us to identify where is the bug came from.
Shuffle blocks are compressed separate (have checksum in it), but broadcast blocks are compressed together, we should add checksum for each of separately.
> Add checksum for block of broadcast
> -----------------------------------
>
> Key: SPARK-18188
> URL: https://issues.apache.org/jira/browse/SPARK-18188
> Project: Spark
> Issue Type: Improvement
> Reporter: Davies Liu
> Assignee: Davies Liu
> Priority: Major
> Fix For: 2.1.0
>
>
> {color:red}着色文本{color}There is an understanding issue for a long time: https://issues.apache.org/jira/browse/SPARK-4105, without any checksum for the blocks, it's very hard for us to identify where is the bug came from.
> Shuffle blocks are compressed separate (have checksum in it), but broadcast blocks are compressed together, we should add checksum for each of separately.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org