You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hop.apache.org by "hansva (via GitHub)" <gi...@apache.org> on 2023/03/16 11:39:02 UTC
[GitHub] [hop] hansva opened a new issue, #2582: [Feature Request]: new transform to obfuscate / mask PII data
hansva opened a new issue, #2582:
URL: https://github.com/apache/hop/issues/2582
### What would you like to happen?
Migration: https://issues.apache.org/jira/browse/HOP-3110
Based on Schrems II, GDPR, and other governing rules for data there is an increased need to make sure PII data is protected when applicable.
Based on a field by field setting, I would like to have an option to modify the contents of a column based on a column matching the criteria. This could be a number of options: obfuscation /masking, null, blank, etc.
Having something like this would allow for metadata driven processing of the data to comply with data processing rules.
### Issue Priority
Priority: 3
### Issue Component
Component: Transforms
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature Request]: new transform to obfuscate / mask PII data (hop)
Posted by "mattcasters (via GitHub)" <gi...@apache.org>.
mattcasters commented on issue #2582:
URL: https://github.com/apache/hop/issues/2582#issuecomment-5893072026
We're looking for re-usable transform that is capable of masking certain fields with PII data. For example, names, address, birthdate, and so on.
There are different ways to mask the data:
* Replace with new data (e.g. `first-name-123`, `address-234`)
* Replace with new data, remember that `Matt` was mapped to `first-name-123` and give every `Matt` the same random value. This is useful for statistically relevant PII data like countries. Have an option to do this in memory or with a database table.
For the new values we want to have options:
* prefix, sufifix, sequence integer (with start value option) or UUID
* A list of values delivered by another transform
It would be nice to be able to build metadata with these masking patterns (a.k.a obfuscation rules) for common fields (name, street, zip-code, ...).
All we would need to do in the transform is give fields a type of masking pattern and it would know what to do.
New metadata element: Masking Pattern
Properties:
* Name
* Description
* PII classification
* Masking / Obfuscation rules (see above)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature Request]: new transform to obfuscate / mask PII data (hop)
Posted by "mattcasters (via GitHub)" <gi...@apache.org>.
mattcasters closed issue #2582: [Feature Request]: new transform to obfuscate / mask PII data
URL: https://github.com/apache/hop/issues/2582
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org