You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Haoji Liu (Jira)" <ji...@apache.org> on 2020/04/09 21:15:00 UTC

[jira] [Created] (GOBBLIN-1111) CsvToJsonConverterV2 should not log raw data

Haoji Liu created GOBBLIN-1111:
----------------------------------

             Summary: CsvToJsonConverterV2 should not log raw data
                 Key: GOBBLIN-1111
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1111
             Project: Apache Gobblin
          Issue Type: Improvement
          Components: gobblin-core
            Reporter: Haoji Liu
            Assignee: Abhishek Tiwari


raw data might contain PII information. The current usage of gobblin I'm seeing when during testing, that we always log on the debug level. And user sensitive data will be collected and stored in your logs. This is a data privacy risk as PII data should not be stored and accessible to all the developers.

This is also polluting the log as we are printing out every single line of record read in.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)