You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2020/01/10 05:05:00 UTC
[jira] [Updated] (SPARK-29779) Compact old event log files and
clean up
[ https://issues.apache.org/jira/browse/SPARK-29779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jungtaek Lim updated SPARK-29779:
---------------------------------
Description:
This issue is to track the effort on compacting old event logs (and cleaning up after compaction) without breaking guaranteeing of compatibility.
Please note that this issue leaves below functionalities for future JIRA issue as the patch for SPARK-29779 is too huge and we decided to break down.
* apply filter in SQL events
* integrate compaction into FsHistoryProvider
* documentation about new configuration
was:This issue is to track the effort on compacting old event logs (and cleaning up after compaction) without breaking guaranteeing of compatibility.
> Compact old event log files and clean up
> ----------------------------------------
>
> Key: SPARK-29779
> URL: https://issues.apache.org/jira/browse/SPARK-29779
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core
> Affects Versions: 3.0.0
> Reporter: Jungtaek Lim
> Priority: Major
>
> This issue is to track the effort on compacting old event logs (and cleaning up after compaction) without breaking guaranteeing of compatibility.
> Please note that this issue leaves below functionalities for future JIRA issue as the patch for SPARK-29779 is too huge and we decided to break down.
> * apply filter in SQL events
> * integrate compaction into FsHistoryProvider
> * documentation about new configuration
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org