You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Srini Karri <sk...@gmail.com> on 2015/03/10 05:36:48 UTC

Spark History server default conf values

Hi All,

What are the default values for the following conf properities if we don't
set in the conf file?

# spark.history.fs.updateInterval 10

# spark.history.retainedApplications 500


Regards,

Srini.

Re: Spark History server default conf values

Posted by Srini Karri <sk...@gmail.com>.

Thank you Charles and Meethu.

On Tue, Mar 10, 2015 at 12:47 AM, Charles Feduke <ch...@gmail.com>
wrote:

> What I found from a quick search of the Spark source code (from my local
> snapshot on January 25, 2015):
>
> // Interval between each check for event log updates
> private val UPDATE_INTERVAL_MS =
> conf.getInt("spark.history.fs.updateInterval",
> conf.getInt("spark.history.updateInterval", 10)) * 1000
>
>   private val retainedApplications =
> conf.getInt("spark.history.retainedApplications", 50)
>
>
> On Tue, Mar 10, 2015 at 12:37 AM Srini Karri <sk...@gmail.com> wrote:
>
>> Hi All,
>>
>> What are the default values for the following conf properities if we
>> don't set in the conf file?
>>
>> # spark.history.fs.updateInterval 10
>>
>> # spark.history.retainedApplications 500
>>
>>
>> Regards,
>>
>> Srini.
>>
>

Re: Spark History server default conf values

Posted by Charles Feduke <ch...@gmail.com>.

What I found from a quick search of the Spark source code (from my local
snapshot on January 25, 2015):

// Interval between each check for event log updates
private val UPDATE_INTERVAL_MS =
conf.getInt("spark.history.fs.updateInterval",
conf.getInt("spark.history.updateInterval", 10)) * 1000

  private val retainedApplications =
conf.getInt("spark.history.retainedApplications", 50)


On Tue, Mar 10, 2015 at 12:37 AM Srini Karri <sk...@gmail.com> wrote:

> Hi All,
>
> What are the default values for the following conf properities if we don't
> set in the conf file?
>
> # spark.history.fs.updateInterval 10
>
> # spark.history.retainedApplications 500
>
>
> Regards,
>
> Srini.
>