You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@slider.apache.org by "hsy541@gmail.com" <hs...@gmail.com> on 2014/11/18 22:48:21 UTC
Application configuration page is outdated?
Hi guys,
I just switch from 40 to 60 and I found the application configuration
doesn't work any more.
http://slider.incubator.apache.org/docs/slider_specs/application_instance_configuration.html
For example :
{
"schema" : "http://example.org/specification/v2.0.0",
"metadata" : {
},
"global" : {
"config_types": "core-site,hdfs-site,hbase-site",
"java_home": "/usr/jdk64/jdk1.7.0_45",
"package_list": "files/hbase-0.96.1-hadoop2-bin.tar",
"create.default.zookeeper.node": "true"
"site.global.app_user": "yarn",
"site.global.app_log_dir": "${AGENT_LOG_ROOT}/app/log",
"site.global.app_pid_dir": "${AGENT_WORK_ROOT}/app/run",
"site.global.security_enabled": "false",
"site.hbase-site.hbase.hstore.flush.retries.number": "120",
"site.hbase-site.hbase.client.keyvalue.maxsize": "10485760",
"site.hbase-site.hbase.hstore.compactionThreshold": "3",
"site.hbase-site.hbase.rootdir": "${NN_URI}/apps/hbase/data",
"site.hbase-site.hbase.tmp.dir": "${AGENT_WORK_ROOT}/work/app/tmp",
"site.hbase-site.hbase.master.info.port":
"${HBASE_MASTER.ALLOCATED_PORT}",
"site.hbase-site.hbase.regionserver.port": "0",
"site.hbase-site.zookeeper.znode.parent": "${DEF_ZK_PATH}",
"site.core-site.fs.defaultFS": "${NN_URI}",
"site.hdfs-site.dfs.namenode.https-address": "${NN_HOST}:50470",
"site.hdfs-site.dfs.namenode.http-address": "${NN_HOST}:50070"
}
}
I can't get config_types in agent python script anymore. Only global
properties are set and caught
Thanks!
Re: Application configuration page is outdated?
Posted by Gour Saha <gs...@hortonworks.com>.
Given you moved to 0.60 it would be a good idea to start with the default
file in this branch - ./app-packages/hbase/appConfig-default.json
The site documentation is getting updated as we speak.
-Gour
On Tue, Nov 18, 2014 at 2:14 PM, hsy541@gmail.com <hs...@gmail.com> wrote:
> I just figure out:
>
> config_types is changed to system_configs
>
> Or you can have configFile in metainfo.xml and create configuration
> folder with xml or env configuration files in it
>
>
> On Tue, Nov 18, 2014 at 2:04 PM, Sumit Mohanty <sm...@hortonworks.com>
> wrote:
>
> > Sharing the metainfo.xml, appConfig.json, and resources.json should be
> > enough.
> >
> > -Sumit
> >
> > On Tue, Nov 18, 2014 at 2:00 PM, Sumit Mohanty <smohanty@hortonworks.com
> >
> > wrote:
> >
> > > Is it possible for you to share the application package? I can browse
> > > through it to see what needs to change.
> > >
> > > On Tue, Nov 18, 2014 at 1:48 PM, hsy541@gmail.com <hs...@gmail.com>
> > > wrote:
> > >
> > >> Hi guys,
> > >>
> > >> I just switch from 40 to 60 and I found the application configuration
> > >> doesn't work any more.
> > >>
> > >>
> >
> http://slider.incubator.apache.org/docs/slider_specs/application_instance_configuration.html
> > >>
> > >> For example :
> > >>
> > >> {
> > >> "schema" : "http://example.org/specification/v2.0.0",
> > >> "metadata" : {
> > >> },
> > >> "global" : {
> > >> "config_types": "core-site,hdfs-site,hbase-site",
> > >>
> > >> "java_home": "/usr/jdk64/jdk1.7.0_45",
> > >> "package_list": "files/hbase-0.96.1-hadoop2-bin.tar",
> > >> "create.default.zookeeper.node": "true"
> > >>
> > >> "site.global.app_user": "yarn",
> > >> "site.global.app_log_dir": "${AGENT_LOG_ROOT}/app/log",
> > >> "site.global.app_pid_dir": "${AGENT_WORK_ROOT}/app/run",
> > >> "site.global.security_enabled": "false",
> > >>
> > >> "site.hbase-site.hbase.hstore.flush.retries.number": "120",
> > >> "site.hbase-site.hbase.client.keyvalue.maxsize": "10485760",
> > >> "site.hbase-site.hbase.hstore.compactionThreshold": "3",
> > >> "site.hbase-site.hbase.rootdir": "${NN_URI}/apps/hbase/data",
> > >> "site.hbase-site.hbase.tmp.dir":
> > "${AGENT_WORK_ROOT}/work/app/tmp",
> > >> "site.hbase-site.hbase.master.info.port":
> > >> "${HBASE_MASTER.ALLOCATED_PORT}",
> > >> "site.hbase-site.hbase.regionserver.port": "0",
> > >> "site.hbase-site.zookeeper.znode.parent": "${DEF_ZK_PATH}",
> > >>
> > >> "site.core-site.fs.defaultFS": "${NN_URI}",
> > >> "site.hdfs-site.dfs.namenode.https-address": "${NN_HOST}:50470",
> > >> "site.hdfs-site.dfs.namenode.http-address": "${NN_HOST}:50070"
> > >> }
> > >> }
> > >>
> > >>
> > >> I can't get config_types in agent python script anymore. Only global
> > >> properties are set and caught
> > >>
> > >>
> > >>
> > >> Thanks!
> > >>
> > >
> > >
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or entity
> to
> > which it is addressed and may contain information that is confidential,
> > privileged and exempt from disclosure under applicable law. If the reader
> > of this message is not the intended recipient, you are hereby notified
> that
> > any printing, copying, dissemination, distribution, disclosure or
> > forwarding of this communication is strictly prohibited. If you have
> > received this communication in error, please contact the sender
> immediately
> > and delete it from your system. Thank You.
> >
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Application configuration page is outdated?
Posted by "hsy541@gmail.com" <hs...@gmail.com>.
I just figure out:
config_types is changed to system_configs
Or you can have configFile in metainfo.xml and create configuration
folder with xml or env configuration files in it
On Tue, Nov 18, 2014 at 2:04 PM, Sumit Mohanty <sm...@hortonworks.com>
wrote:
> Sharing the metainfo.xml, appConfig.json, and resources.json should be
> enough.
>
> -Sumit
>
> On Tue, Nov 18, 2014 at 2:00 PM, Sumit Mohanty <sm...@hortonworks.com>
> wrote:
>
> > Is it possible for you to share the application package? I can browse
> > through it to see what needs to change.
> >
> > On Tue, Nov 18, 2014 at 1:48 PM, hsy541@gmail.com <hs...@gmail.com>
> > wrote:
> >
> >> Hi guys,
> >>
> >> I just switch from 40 to 60 and I found the application configuration
> >> doesn't work any more.
> >>
> >>
> http://slider.incubator.apache.org/docs/slider_specs/application_instance_configuration.html
> >>
> >> For example :
> >>
> >> {
> >> "schema" : "http://example.org/specification/v2.0.0",
> >> "metadata" : {
> >> },
> >> "global" : {
> >> "config_types": "core-site,hdfs-site,hbase-site",
> >>
> >> "java_home": "/usr/jdk64/jdk1.7.0_45",
> >> "package_list": "files/hbase-0.96.1-hadoop2-bin.tar",
> >> "create.default.zookeeper.node": "true"
> >>
> >> "site.global.app_user": "yarn",
> >> "site.global.app_log_dir": "${AGENT_LOG_ROOT}/app/log",
> >> "site.global.app_pid_dir": "${AGENT_WORK_ROOT}/app/run",
> >> "site.global.security_enabled": "false",
> >>
> >> "site.hbase-site.hbase.hstore.flush.retries.number": "120",
> >> "site.hbase-site.hbase.client.keyvalue.maxsize": "10485760",
> >> "site.hbase-site.hbase.hstore.compactionThreshold": "3",
> >> "site.hbase-site.hbase.rootdir": "${NN_URI}/apps/hbase/data",
> >> "site.hbase-site.hbase.tmp.dir":
> "${AGENT_WORK_ROOT}/work/app/tmp",
> >> "site.hbase-site.hbase.master.info.port":
> >> "${HBASE_MASTER.ALLOCATED_PORT}",
> >> "site.hbase-site.hbase.regionserver.port": "0",
> >> "site.hbase-site.zookeeper.znode.parent": "${DEF_ZK_PATH}",
> >>
> >> "site.core-site.fs.defaultFS": "${NN_URI}",
> >> "site.hdfs-site.dfs.namenode.https-address": "${NN_HOST}:50470",
> >> "site.hdfs-site.dfs.namenode.http-address": "${NN_HOST}:50070"
> >> }
> >> }
> >>
> >>
> >> I can't get config_types in agent python script anymore. Only global
> >> properties are set and caught
> >>
> >>
> >>
> >> Thanks!
> >>
> >
> >
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
Re: Application configuration page is outdated?
Posted by Sumit Mohanty <sm...@hortonworks.com>.
Sharing the metainfo.xml, appConfig.json, and resources.json should be
enough.
-Sumit
On Tue, Nov 18, 2014 at 2:00 PM, Sumit Mohanty <sm...@hortonworks.com>
wrote:
> Is it possible for you to share the application package? I can browse
> through it to see what needs to change.
>
> On Tue, Nov 18, 2014 at 1:48 PM, hsy541@gmail.com <hs...@gmail.com>
> wrote:
>
>> Hi guys,
>>
>> I just switch from 40 to 60 and I found the application configuration
>> doesn't work any more.
>>
>> http://slider.incubator.apache.org/docs/slider_specs/application_instance_configuration.html
>>
>> For example :
>>
>> {
>> "schema" : "http://example.org/specification/v2.0.0",
>> "metadata" : {
>> },
>> "global" : {
>> "config_types": "core-site,hdfs-site,hbase-site",
>>
>> "java_home": "/usr/jdk64/jdk1.7.0_45",
>> "package_list": "files/hbase-0.96.1-hadoop2-bin.tar",
>> "create.default.zookeeper.node": "true"
>>
>> "site.global.app_user": "yarn",
>> "site.global.app_log_dir": "${AGENT_LOG_ROOT}/app/log",
>> "site.global.app_pid_dir": "${AGENT_WORK_ROOT}/app/run",
>> "site.global.security_enabled": "false",
>>
>> "site.hbase-site.hbase.hstore.flush.retries.number": "120",
>> "site.hbase-site.hbase.client.keyvalue.maxsize": "10485760",
>> "site.hbase-site.hbase.hstore.compactionThreshold": "3",
>> "site.hbase-site.hbase.rootdir": "${NN_URI}/apps/hbase/data",
>> "site.hbase-site.hbase.tmp.dir": "${AGENT_WORK_ROOT}/work/app/tmp",
>> "site.hbase-site.hbase.master.info.port":
>> "${HBASE_MASTER.ALLOCATED_PORT}",
>> "site.hbase-site.hbase.regionserver.port": "0",
>> "site.hbase-site.zookeeper.znode.parent": "${DEF_ZK_PATH}",
>>
>> "site.core-site.fs.defaultFS": "${NN_URI}",
>> "site.hdfs-site.dfs.namenode.https-address": "${NN_HOST}:50470",
>> "site.hdfs-site.dfs.namenode.http-address": "${NN_HOST}:50070"
>> }
>> }
>>
>>
>> I can't get config_types in agent python script anymore. Only global
>> properties are set and caught
>>
>>
>>
>> Thanks!
>>
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Application configuration page is outdated?
Posted by Sumit Mohanty <sm...@hortonworks.com>.
Is it possible for you to share the application package? I can browse
through it to see what needs to change.
On Tue, Nov 18, 2014 at 1:48 PM, hsy541@gmail.com <hs...@gmail.com> wrote:
> Hi guys,
>
> I just switch from 40 to 60 and I found the application configuration
> doesn't work any more.
>
> http://slider.incubator.apache.org/docs/slider_specs/application_instance_configuration.html
>
> For example :
>
> {
> "schema" : "http://example.org/specification/v2.0.0",
> "metadata" : {
> },
> "global" : {
> "config_types": "core-site,hdfs-site,hbase-site",
>
> "java_home": "/usr/jdk64/jdk1.7.0_45",
> "package_list": "files/hbase-0.96.1-hadoop2-bin.tar",
> "create.default.zookeeper.node": "true"
>
> "site.global.app_user": "yarn",
> "site.global.app_log_dir": "${AGENT_LOG_ROOT}/app/log",
> "site.global.app_pid_dir": "${AGENT_WORK_ROOT}/app/run",
> "site.global.security_enabled": "false",
>
> "site.hbase-site.hbase.hstore.flush.retries.number": "120",
> "site.hbase-site.hbase.client.keyvalue.maxsize": "10485760",
> "site.hbase-site.hbase.hstore.compactionThreshold": "3",
> "site.hbase-site.hbase.rootdir": "${NN_URI}/apps/hbase/data",
> "site.hbase-site.hbase.tmp.dir": "${AGENT_WORK_ROOT}/work/app/tmp",
> "site.hbase-site.hbase.master.info.port":
> "${HBASE_MASTER.ALLOCATED_PORT}",
> "site.hbase-site.hbase.regionserver.port": "0",
> "site.hbase-site.zookeeper.znode.parent": "${DEF_ZK_PATH}",
>
> "site.core-site.fs.defaultFS": "${NN_URI}",
> "site.hdfs-site.dfs.namenode.https-address": "${NN_HOST}:50470",
> "site.hdfs-site.dfs.namenode.http-address": "${NN_HOST}:50070"
> }
> }
>
>
> I can't get config_types in agent python script anymore. Only global
> properties are set and caught
>
>
>
> Thanks!
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.