You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "MrAsanjar ." <af...@gmail.com> on 2016/11/15 06:45:27 UTC

spark 2.0 and charms

Kevin,
Could we modify spark charms to deploy spark 2.0 as well? Or is it
hardcoded to install only from Bigtop v1.1.0 repository.

Re: spark 2.0 and charms

Posted by Cory Johns <co...@canonical.com>.
To clarify, this is for development and testing purposes only, and it's
unlikely that charm would work with the other Bigtop charms unless they
were built against Bigtop master as well.

On Wed, Nov 23, 2016 at 12:00 PM, Cory Johns <co...@canonical.com>
wrote:

> Amir,
>
> While not available as a deploy-time config, if you build the Spark charm
> from source with `charm build`, you add the following to the "options"
> section in layer.yaml to have it deploy from Bigtop master:
>
>   apache-bigtop-base:
>     bigtop_version: master
>
> (Note, this should be indented at the same level as "basic:" and
> "hadoop-client:")
>
> If you don't have charm-tools installed and are comfortable with Docker,
> you can use https://hub.docker.com/r/jujusolutions/charmbox/ to get all
> the tools necessary to build the charm.
>
> On Tue, Nov 15, 2016 at 1:45 AM, MrAsanjar . <af...@gmail.com> wrote:
>
>> Kevin,
>> Could we modify spark charms to deploy spark 2.0 as well? Or is it
>> hardcoded to install only from Bigtop v1.1.0 repository.
>>
>
>

Re: spark 2.0 and charms

Posted by Cory Johns <co...@canonical.com>.
Amir,

While not available as a deploy-time config, if you build the Spark charm
from source with `charm build`, you add the following to the "options"
section in layer.yaml to have it deploy from Bigtop master:

  apache-bigtop-base:
    bigtop_version: master

(Note, this should be indented at the same level as "basic:" and
"hadoop-client:")

If you don't have charm-tools installed and are comfortable with Docker,
you can use https://hub.docker.com/r/jujusolutions/charmbox/ to get all the
tools necessary to build the charm.

On Tue, Nov 15, 2016 at 1:45 AM, MrAsanjar . <af...@gmail.com> wrote:

> Kevin,
> Could we modify spark charms to deploy spark 2.0 as well? Or is it
> hardcoded to install only from Bigtop v1.1.0 repository.
>