You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "zhoukang (JIRA)" <ji...@apache.org> on 2017/10/12 09:59:00 UTC
[jira] [Updated] (SPARK-22264) History server will be unavailable
if there is an event log file with large size
[ https://issues.apache.org/jira/browse/SPARK-22264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
zhoukang updated SPARK-22264:
-----------------------------
Description:
History server will be unavailable if there is an event log file with large size.
Large size here means the replaying time is too long.
We can fix this to add a timeout for event log replaying.
Here is an example:
Event log file size is bigger than 130GB.
{code:java}
hadoop *144149840801* 2017-08-29 14:03 /spark/xxx/log/history/application_1501588539284_1118255_1.lz4.inprogress
{code}
was:
History server will be unavailable if there is an event log file with large size.
Large size here means the replaying time is too long.
We can fix this to add a timeout for event log replaying.
Here is an example:
Event log file size is bigger than 130GB.
> History server will be unavailable if there is an event log file with large size
> --------------------------------------------------------------------------------
>
> Key: SPARK-22264
> URL: https://issues.apache.org/jira/browse/SPARK-22264
> Project: Spark
> Issue Type: Bug
> Components: Deploy
> Affects Versions: 2.1.0
> Reporter: zhoukang
>
> History server will be unavailable if there is an event log file with large size.
> Large size here means the replaying time is too long.
> We can fix this to add a timeout for event log replaying.
> Here is an example:
> Event log file size is bigger than 130GB.
> {code:java}
> hadoop *144149840801* 2017-08-29 14:03 /spark/xxx/log/history/application_1501588539284_1118255_1.lz4.inprogress
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org