You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Akira Ajisaka (Jira)" <ji...@apache.org> on 2026/03/24 05:49:00 UTC

[jira] [Commented] (SPARK-47172) Upgrade Transport block cipher mode to GCM

    [ https://issues.apache.org/jira/browse/SPARK-47172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18067921#comment-18067921 ] 

Akira Ajisaka commented on SPARK-47172:
---------------------------------------

We faced the same issue when enabling AES/GCM/NoPadding in YARN cluster. We are trying to fix the issue and submit a PR once the issue is resolved in our environment.

> Upgrade Transport block cipher mode to GCM
> ------------------------------------------
>
>                 Key: SPARK-47172
>                 URL: https://issues.apache.org/jira/browse/SPARK-47172
>             Project: Spark
>          Issue Type: Improvement
>          Components: Security
>    Affects Versions: 3.4.2, 3.5.0
>            Reporter: Steve Weis
>            Assignee: Steve Weis
>            Priority: Minor
>              Labels: pull-request-available
>             Fix For: 3.5.2, 3.4.4, 4.0.0
>
>         Attachments: spark-4.1.1-AES-CTR-NoPadding-good.txt, spark-4.1.1-AES-GCM-NoPadding-authEngineVersion-1-bad.txt, spark-4.1.1-AES-GCM-NoPadding-authEngineVersion-2-bad.txt
>
>
> The cipher transformation currently used for encrypting RPC calls is an unauthenticated mode (AES/CTR/NoPadding). This needs to be upgraded to an authenticated mode (AES/GCM/NoPadding) to prevent ciphertext from being modified in transit.
> The relevant line is here: [https://github.com/apache/spark/blob/a939a7d0fd9c6b23c879cbee05275c6fbc939e38/common/network-common/src/main/java/org/apache/spark/network/util/TransportConf.java#L220]
> GCM is relatively more computationally expensive than CTR and adds a 16-byte block of authentication tag data to each payload. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org