You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Felix Cheung (JIRA)" <ji...@apache.org> on 2016/01/17 19:38:39 UTC
[jira] [Commented] (SPARK-12790) Remove HistoryServer old multiple
files format
[ https://issues.apache.org/jira/browse/SPARK-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15103856#comment-15103856 ]
Felix Cheung commented on SPARK-12790:
--------------------------------------
is this simply removing the code path with `isLegacyLogDirectory`? I could take a shot at this if you'd like
> Remove HistoryServer old multiple files format
> ----------------------------------------------
>
> Key: SPARK-12790
> URL: https://issues.apache.org/jira/browse/SPARK-12790
> Project: Spark
> Issue Type: Sub-task
> Components: Deploy
> Reporter: Andrew Or
>
> HistoryServer has 2 formats. The old one makes a directory and puts multiple files in there (APPLICATION_COMPLETE, EVENT_LOG1 etc.). The new one has just 1 file called local_2593759238651.log or something.
> It's been a nightmare to maintain both code paths. We should just remove the old legacy format (which has been out of use for many versions now) when we still have the chance.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org