[jira] [Created] (SPARK-15698) Ability to remove old metadata for structure streaming MetadataLog

["Saisai Shao (JIRA)" <ji...@apache.org>]

Saisai Shao created SPARK-15698:
-----------------------------------

             Summary: Ability to remove old metadata for structure streaming MetadataLog
                 Key: SPARK-15698
                 URL: https://issues.apache.org/jira/browse/SPARK-15698
             Project: Spark
          Issue Type: Improvement
          Components: SQL, Streaming
            Reporter: Saisai Shao
            Priority: Minor


Current MetadataLog lacks the ability to remove old checkpoint file, we'd better add this functionality to the MetadataLog and honor it in the place where MetadataLog is used, that will reduce unnecessary small files in the long running scenarios.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org