[jira] [Created] (HIVE-26784) Provide an option to skip malformed json entries and process the rest of the data in case JSON Serde

["Taraka Rama Rao Lethavadla (Jira)" <ji...@apache.org>]

Taraka Rama Rao Lethavadla created HIVE-26784:
-------------------------------------------------

             Summary: Provide an option to skip malformed json entries and process the rest of the data in case JSON Serde
                 Key: HIVE-26784
                 URL: https://issues.apache.org/jira/browse/HIVE-26784
             Project: Hive
          Issue Type: Improvement
          Components: Hive
            Reporter: Taraka Rama Rao Lethavadla


We may want to create hive tables on top of audit data generated by ranger (not only HDFS audit but other services as well) to be able to analyze the same.

Based on this case, some audit records may become corrupt. Improving the hive built-in json serde to provide an option (in tblproperties and via session configurations for example) to allow ignoring malformed records (or to provide empty rows) would assist users achieve this goal without using third-party/custom serdes,

for example:
#see ignore.malformed.json

[https://aws.amazon.com/premiumsupport/knowledge-center/error-json-athena/#:~:text=you%20can%20ignore%20malformed%20records]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)