You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Erwan ALLAIN <ea...@gmail.com> on 2016/11/09 11:06:15 UTC

Application config management

Hi everyone,

I d like to know what kind of configuration mechanism is used in general ?

Below is what I m going to implement but I d like to know if there is any
"standard way"

1) put configuration in hdfs
2) specify extrajavaoptions (driver and worker) with the hdfs url (
hdfs://ip:port/config)
3) in application code,
 - concatenate hdfs path + config file
 - download file
 - load with typesafe config

What do you think ?