You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Vinod KC (Jira)" <ji...@apache.org> on 2023/01/17 21:30:00 UTC
[jira] [Comment Edited] (SPARK-40687) Support data masking built-in Function 'mask'
[ https://issues.apache.org/jira/browse/SPARK-40687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17677988#comment-17677988 ]
Vinod KC edited comment on SPARK-40687 at 1/17/23 9:29 PM:
-----------------------------------------------------------
Note: In the udf 'mask', using -1 as ignore parameter in String type argument is not a standard way.
Please refer SPARK-42070 , it changes the default value of the argument of m{*}ask{*} udf from -1 to NULL
was (Author: vinodkc):
Note: Please refer [SPARK-42070|https://issues.apache.org/jira/browse/SPARK-42070] , it changes the default value of argument of Mask udf from -1 to NULL
> Support data masking built-in Function 'mask'
> ----------------------------------------------
>
> Key: SPARK-40687
> URL: https://issues.apache.org/jira/browse/SPARK-40687
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 3.4.0
> Reporter: Vinod KC
> Assignee: Vinod KC
> Priority: Minor
> Fix For: 3.4.0
>
>
> Support data masking built-in Function *mask*
> Return a masked version of str. By default, upper case letters should be converted to "X", lower case letters should be converted to "x" and numbers should be converted to "n". For example mask("abcd-EFGH-8765-4321") results in xxxx-XXXX-nnnn-nnnn. Should be able override the characters used in the mask by supplying additional arguments: the second argument controls the mask character for upper case letters, the third argument for lower case letters and the fourth argument for numbers. For example, mask("abcd-EFGH-8765-4321", "U", "l", "#") should result in llll-UUUU-####-####
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org