You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@slider.apache.org by "Yong Wang (JIRA)" <ji...@apache.org> on 2015/06/26 12:02:04 UTC

[jira] [Commented] (SLIDER-780) Support for Docker based application packaging in Slider

    [ https://issues.apache.org/jira/browse/SLIDER-780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602640#comment-14602640 ] 

Yong Wang commented on SLIDER-780:
----------------------------------

Hi Thomas, I'm very intersted in Docker based app packaging and am exited to see Slider 0.8.0 is released, I installed this version of Slider and tried to follow the instructions to run the sample application given in SlidersupportingDockersummary.pdf in the attachments of this ticket. However, I have no luck to successfully create the basic application described in Senario 1 in the PDF. 
It report an error indicated that the component 'MEMCACHED' is not a member of application.

I used the metainfo.json and resources.json provided in the PDF and the command I tried to create app is:
slider create memcached --metainfo metainfo.json --resources resources.json

Output Is:
2015-06-26 17:47:26,296 [main] INFO  client.RMProxy - Connecting to ResourceManager at dsj-s6/10.35.22.72:8032
2015-06-26 17:47:26,895 [main] INFO  persist.AppDefinitionPersister - Using default app def path hdfs://dsj-s6:8020/user/hdev/.slider/cluster/memcached/appdef
2015-06-26 17:47:26,898 [main] INFO  persist.AppDefinitionPersister - Setting app package to hdfs://dsj-s6:8020/user/hdev/.slider/cluster/memcached/appdef/appPkg.zip.
2015-06-26 17:47:27,288 [main] INFO  persist.AppDefinitionPersister - Processing app package/folder /tmp/1435312046889-0/default for appPkg.zip
2015-06-26 17:47:27,290 [main] INFO  tools.SliderUtils - Zipping folder /tmp/1435312046889-0/default to /tmp/1435312047288-0/appPkg.zip
2015-06-26 17:47:27,328 [main] INFO  agent.AgentClientProvider - Validating app definition hdfs://dsj-s6:8020/user/hdev/.slider/cluster/memcached/appdef/appPkg.zip
2015-06-26 17:47:27,331 [main] INFO  agent.AgentUtils - Reading metainfo at hdfs://dsj-s6:8020/user/hdev/.slider/cluster/memcached/appdef/appPkg.zip
2015-06-26 17:47:27,450 [main] ERROR metadata.Metainfo - Malformed app definition: Expect application as the top level element for metainfo
2015-06-26 17:47:27,451 [main] INFO  client.SliderClient - Error Component MEMCACHED is not a member of application. validating application instance definition
2015-06-26 17:47:27,460 [main] INFO  client.SliderClient - {,
"internal": {
  "schema" : "http://example.org/specification/v2.0.0",
  "metadata" : {
    "create.hadoop.deployed.info" : "branch-2.6.0 @18e43357c8f927c0695f1e9522859d6a",
    "create.application.build.info" : "Slider Core-0.80.0-incubating Built against commit# d7e3449fa6 on Java 1.7.0_60 by gsaha",
    "create.hadoop.build.info" : "2.6.0",
    "create.time.millis" : "1435312046903",
    "create.time" : "26 Jun 2015 09:47:26 GMT"
  },
  "global" : {
    "internal.generated.conf.path" : "hdfs://dsj-s6:8020/user/hdev/.slider/cluster/memcached/generated",
    "internal.appdef.dir.path" : "hdfs://dsj-s6:8020/user/hdev/.slider/cluster/memcached/tmp/appdef",
    "application.name" : "memcached",
    "slider.cluster.directory.permissions" : "0770",
    "internal.addons.dir.path" : "hdfs://dsj-s6:8020/user/hdev/.slider/cluster/memcached/tmp/addons",
    "internal.provider.name" : "agent",
    "internal.data.dir.path" : "hdfs://dsj-s6:8020/user/hdev/.slider/cluster/memcached/database",
    "internal.tmp.dir" : "hdfs://dsj-s6:8020/user/hdev/.slider/cluster/memcached/tmp",
    "internal.snapshot.conf.path" : "hdfs://dsj-s6:8020/user/hdev/.slider/cluster/memcached/snapshot",
    "slider.data.directory.permissions" : "0770",
    "internal.container.failure.shortlife" : "60000",
    "internal.am.tmp.dir" : "hdfs://dsj-s6:8020/user/hdev/.slider/cluster/memcached/tmp/appmaster",
    "internal.container.failure.threshold" : "5"
  },
  "credentials" : { },
  "components" : { }
},
"resources": {
  "schema" : "http://example.org/specification/v2.0.0",
  "metadata" : { },
  "global" : { },
  "credentials" : { },
  "components" : {
    "slider-appmaster" : {
      "yarn.memory" : "1024",
      "yarn.vcores" : "1",
      "yarn.component.instances" : "1"
    },
    "MEMCACHED" : {
      "yarn.memory" : "512",
      "yarn.role.priority" : "1",
      "yarn.component.instances" : "2"
    }
  }
},
"appConf" :{
  "schema" : "http://example.org/specification/v2.0.0",
  "metadata" : { },
  "global" : {
    "site.fs.defaultFS" : "hdfs://dsj-s6:8020",
    "env.MALLOC_ARENA_MAX" : "4",
    "site.fs.default.name" : "hdfs://dsj-s6:8020",
    "zookeeper.path" : "/services/slider/users/hdev/memcached",
    "zookeeper.quorum" : "localhost:2181",
    "zookeeper.hosts" : "localhost",
    "application.def" : "hdfs://dsj-s6:8020/user/hdev/.slider/cluster/memcached/appdef/appPkg.zip"
  },
  "credentials" : { },
  "components" : {
    "slider-appmaster" : {
      "jvm.heapsize" : "256M"
    }
  }
}}
2015-06-26 17:47:27,460 [main] ERROR main.ServiceLauncher - Component MEMCACHED is not a member of application.
2015-06-26 17:47:27,462 [main] INFO  util.ExitUtil - Exiting with status 77


> Support for Docker based application packaging in Slider
> --------------------------------------------------------
>
>                 Key: SLIDER-780
>                 URL: https://issues.apache.org/jira/browse/SLIDER-780
>             Project: Slider
>          Issue Type: New Feature
>            Reporter: thomas liu
>            Assignee: thomas liu
>             Fix For: Slider 0.80
>
>         Attachments: JIRA-780-001.patch, JIRA-780-002.patch, SlidersupportingDockersummary (1).pdf
>
>
> Enable Slider to deploy an application defined as Docker image, monitor its running status, fetching exported configs, and maintain its lifecycle.
> Please find the details of this ticket in the attachment 'SlidersupportingDockersummary(1).pdf'



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)