You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@unomi.apache.org by Serge Huber <sh...@apache.org> on 2019/04/07 12:54:20 UTC
Re: Running Unomi on Docker
Hello Michael,
I was thinking about your Docker work, and I would really like to have
something like this in the Apache Unomi project. Would you consider
submitting your Docker work as a PR in a "docker" sub-directory? I'd like
to have the compose configuration and build upon it for the new environment
variable support.
What do you think?
Regards,
Serge...
On Sat, Dec 1, 2018 at 5:28 PM Michael Ghen <mi...@mikeghen.com> wrote:
> I think you got back to me in another thread. I was able to get this
> sorted out, final entry point script:
> https://github.com/mikeghen/unomi-docker/blob/master/entrypoint.sh
>
> Also added a wait for ElasticSearch to startup which solved a lot
> of problems I was having.
>
> I put out a PR to add a Running Unomi in Docker tutorial to the resources
> page BTW: https://github.com/apache/incubator-unomi-site/pull/12
>
> I shared some of the work I've done with Unomi with some of the senior
> software engineers on our team and they were impressed with the tool.
>
> On Sat, Dec 1, 2018 at 10:12 AM Serge Huber <sh...@apache.org> wrote:
>
>> Hello Michael,
>>
>> I thought I had already replied to this question, but you can start
>> with the command line parameter :
>>
>> -Dunomi.autoStart=true
>>
>> and that way you won't have to wait for the sleep 60 since you won't
>> have to issue the unomi:start command anymore.
>>
>> Regards,
>> Serge...
>> On Sat, Nov 17, 2018 at 5:37 PM Michael Ghen <mi...@mikeghen.com> wrote:
>> >
>> > Ok, I believe I resolved my issue by disabling xpack security
>> "xpack.security.enabled=false." Is there any way to get a better error
>> logging from ES connection failures?
>> >
>> > I'd still like to find a better way to start Unomi than what I'm doing
>> with "sleep 60" if anyone has any ideas.
>> >
>> > On Sat, Nov 17, 2018 at 9:44 AM Michael Ghen <mi...@mikeghen.com> wrote:
>> >>
>> >> Thanks JB, I looked at that and based my image on your Dockerfile.
>> That was really helpful to get the image setup. I can't figure out how to
>> start Karaf but I can figure out how to start Unomi. I looked into how to
>> run commands on boot, I tried something like this:
>> https://stackoverflow.com/questions/26434360/script-karaf-shell-commands
>> >>
>> >> This is what I have in my startup script, does this look the the right
>> way to start and run Unomi in the container:
>> >>
>> >> #!/bin/sh
>> >> $KARAF_HOME/bin/start
>> >> sleep 60
>> >> $KARAF_HOME/bin/client "unomi:start"
>> >> echo "Started Unomi"
>> >> tail -f $KARAF_HOME/data/log/karaf.log
>> >>
>> >>
>> >> On Sat, Nov 17, 2018 at 1:20 AM Jean-Baptiste Onofré <jb...@nanthrax.net>
>> wrote:
>> >>>
>> >>> Hi Michael,
>> >>>
>> >>> I blogged about Docker with Apache Karaf:
>> >>>
>> >>> http://blog.nanthrax.net/?p=839
>> >>>
>> >>> Regards
>> >>> JB
>> >>>
>> >>> On 17/11/2018 06:18, Michael Ghen wrote:
>> >>> > Hi everyone,
>> >>> >
>> >>> > I looked into running Karaf on Docker and I feel like I was able to
>> >>> > figure that out.
>> >>> >
>> >>> > I can't seem to get Unomi running though so I was hoping someone
>> here
>> >>> > might be able to help me out. I'm having two problems. First, I
>> can't
>> >>> > seem to get Unomi to start. I have a start_with_ip.sh entry point
>> script
>> >>> > which I thought would start up Unomi but it seems it's not working.
>> >>> > Second, when I manually start Unomi, it can't connect to
>> Elasticsearch.
>> >>> > I'm using docker compose to run a Unomi and Elasticsearch container
>> so
>> >>> > my second problem might be docker related.
>> >>> >
>> >>> > Repo with the code I'm working on
>> >>> > here: https://github.com/mikeghen/unomi-docker
>> >>> >
>> >>> > I've put the code into a repo, once I get it working I think it
>> will be
>> >>> > a good resource to add. It's basically a requirement for any system
>> we
>> >>> > want to use that it can be run on Kubernetes so getting this setup
>> in
>> >>> > docker will help me get Unomi in production. Please, let me know
>> what
>> >>> > you think. I'm not sure what else to try to get it running.
>> >>> >
>> >>>
>> >>> --
>> >>> Jean-Baptiste Onofré
>> >>> jbonofre@apache.org
>> >>> http://blog.nanthrax.net
>> >>> Talend - http://www.talend.com
>>
>
Re: Running Unomi on Docker
Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
OK for a docker-compose "manual" for 1.4.0.
Anyway, Karaf 4.2 refactoring is plan for 1.5.x.
Regards
JB
On 07/04/2019 16:32, Serge Huber wrote:
>
> Sorry JB I forgot our discussion the other day :)
>
> Could we get the Karaf docker generation to work with docker-compose so
> that we can use the ElasticSearch images ?
>
> Anyway we could look at a scenario such as :
> - 1.4.0 with Docker done manually
> - 1.5.0 with Karaf 4.2, possibly ES 7 and the new Docker generation ?
>
> I'd like to release 1.4.0 soon as it is relatively stable and I think it
> would be good to have a release outside of incubation, so I would prefer
> to avoid having too much coming into the master right away. What do you
> think?
>
> Regards,
> Serge...
>
> On Sun, Apr 7, 2019 at 3:33 PM Jean-Baptiste Onofré <jb@nanthrax.net
> <ma...@nanthrax.net>> wrote:
>
> Hi,
>
> I can handle the "official" apache part of docker.
>
> It has to be in a dedicated module as I did for Karaf.
>
> By the way, in the Karaf 4.2.x update and refactoring of Unomi, I also
> tested the Dockerfile generation (using the karaf plugin).
>
> Regards
> JB
>
> On 07/04/2019 14:54, Serge Huber wrote:
> >
> > Hello Michael,
> >
> > I was thinking about your Docker work, and I would really like to
> have
> > something like this in the Apache Unomi project. Would you consider
> > submitting your Docker work as a PR in a "docker" sub-directory? I'd
> > like to have the compose configuration and build upon it for the new
> > environment variable support.
> >
> > What do you think?
> >
> > Regards,
> > Serge...
> >
> > On Sat, Dec 1, 2018 at 5:28 PM Michael Ghen <mike@mikeghen.com
> <ma...@mikeghen.com>
> > <mailto:mike@mikeghen.com <ma...@mikeghen.com>>> wrote:
> >
> > I think you got back to me in another thread. I was able to
> get this
> > sorted out, final entry point script:
> > https://github.com/mikeghen/unomi-docker/blob/master/entrypoint.sh
> >
> > Also added a wait for ElasticSearch to startup which solved a lot
> > of problems I was having.
> >
> > I put out a PR to add a Running Unomi in Docker tutorial to the
> > resources page BTW:
> > https://github.com/apache/incubator-unomi-site/pull/12
> >
> > I shared some of the work I've done with Unomi with some of the
> > senior software engineers on our team and they were impressed with
> > the tool.
> >
> > On Sat, Dec 1, 2018 at 10:12 AM Serge Huber <shuber@apache.org
> <ma...@apache.org>
> > <mailto:shuber@apache.org <ma...@apache.org>>> wrote:
> >
> > Hello Michael,
> >
> > I thought I had already replied to this question, but you
> can start
> > with the command line parameter :
> >
> > -Dunomi.autoStart=true
> >
> > and that way you won't have to wait for the sleep 60 since
> you won't
> > have to issue the unomi:start command anymore.
> >
> > Regards,
> > Serge...
> > On Sat, Nov 17, 2018 at 5:37 PM Michael Ghen
> <mike@mikeghen.com <ma...@mikeghen.com>
> > <mailto:mike@mikeghen.com <ma...@mikeghen.com>>> wrote:
> > >
> > > Ok, I believe I resolved my issue by disabling xpack
> security
> > "xpack.security.enabled=false." Is there any way to get a
> better
> > error logging from ES connection failures?
> > >
> > > I'd still like to find a better way to start Unomi than
> what
> > I'm doing with "sleep 60" if anyone has any ideas.
> > >
> > > On Sat, Nov 17, 2018 at 9:44 AM Michael Ghen
> > <mike@mikeghen.com <ma...@mikeghen.com>
> <mailto:mike@mikeghen.com <ma...@mikeghen.com>>> wrote:
> > >>
> > >> Thanks JB, I looked at that and based my image on your
> > Dockerfile. That was really helpful to get the image setup. I
> > can't figure out how to start Karaf but I can figure out
> how to
> > start Unomi. I looked into how to run commands on boot, I
> tried
> > something like this:
> >
> https://stackoverflow.com/questions/26434360/script-karaf-shell-commands
> > >>
> > >> This is what I have in my startup script, does this
> look the
> > the right way to start and run Unomi in the container:
> > >>
> > >> #!/bin/sh
> > >> $KARAF_HOME/bin/start
> > >> sleep 60
> > >> $KARAF_HOME/bin/client "unomi:start"
> > >> echo "Started Unomi"
> > >> tail -f $KARAF_HOME/data/log/karaf.log
> > >>
> > >>
> > >> On Sat, Nov 17, 2018 at 1:20 AM Jean-Baptiste Onofré
> > <jb@nanthrax.net <ma...@nanthrax.net>
> <mailto:jb@nanthrax.net <ma...@nanthrax.net>>> wrote:
> > >>>
> > >>> Hi Michael,
> > >>>
> > >>> I blogged about Docker with Apache Karaf:
> > >>>
> > >>> http://blog.nanthrax.net/?p=839
> > >>>
> > >>> Regards
> > >>> JB
> > >>>
> > >>> On 17/11/2018 06:18, Michael Ghen wrote:
> > >>> > Hi everyone,
> > >>> >
> > >>> > I looked into running Karaf on Docker and I feel like I
> > was able to
> > >>> > figure that out.
> > >>> >
> > >>> > I can't seem to get Unomi running though so I was
> hoping
> > someone here
> > >>> > might be able to help me out. I'm having two problems.
> > First, I can't
> > >>> > seem to get Unomi to start. I have a start_with_ip.sh
> > entry point script
> > >>> > which I thought would start up Unomi but it seems it's
> > not working.
> > >>> > Second, when I manually start Unomi, it can't
> connect to
> > Elasticsearch.
> > >>> > I'm using docker compose to run a Unomi and
> Elasticsearch
> > container so
> > >>> > my second problem might be docker related.
> > >>> >
> > >>> > Repo with the code I'm working on
> > >>> > here: https://github.com/mikeghen/unomi-docker
> > >>> >
> > >>> > I've put the code into a repo, once I get it working I
> > think it will be
> > >>> > a good resource to add. It's basically a
> requirement for
> > any system we
> > >>> > want to use that it can be run on Kubernetes so getting
> > this setup in
> > >>> > docker will help me get Unomi in production.
> Please, let
> > me know what
> > >>> > you think. I'm not sure what else to try to get it
> running.
> > >>> >
> > >>>
> > >>> --
> > >>> Jean-Baptiste Onofré
> > >>> jbonofre@apache.org <ma...@apache.org>
> <mailto:jbonofre@apache.org <ma...@apache.org>>
> > >>> http://blog.nanthrax.net
> > >>> Talend - http://www.talend.com
> >
>
--
Jean-Baptiste Onofré
jbonofre@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
Re: Running Unomi on Docker
Posted by Serge Huber <sh...@apache.org>.
Sorry JB I forgot our discussion the other day :)
Could we get the Karaf docker generation to work with docker-compose so
that we can use the ElasticSearch images ?
Anyway we could look at a scenario such as :
- 1.4.0 with Docker done manually
- 1.5.0 with Karaf 4.2, possibly ES 7 and the new Docker generation ?
I'd like to release 1.4.0 soon as it is relatively stable and I think it
would be good to have a release outside of incubation, so I would prefer to
avoid having too much coming into the master right away. What do you think?
Regards,
Serge...
On Sun, Apr 7, 2019 at 3:33 PM Jean-Baptiste Onofré <jb...@nanthrax.net> wrote:
> Hi,
>
> I can handle the "official" apache part of docker.
>
> It has to be in a dedicated module as I did for Karaf.
>
> By the way, in the Karaf 4.2.x update and refactoring of Unomi, I also
> tested the Dockerfile generation (using the karaf plugin).
>
> Regards
> JB
>
> On 07/04/2019 14:54, Serge Huber wrote:
> >
> > Hello Michael,
> >
> > I was thinking about your Docker work, and I would really like to have
> > something like this in the Apache Unomi project. Would you consider
> > submitting your Docker work as a PR in a "docker" sub-directory? I'd
> > like to have the compose configuration and build upon it for the new
> > environment variable support.
> >
> > What do you think?
> >
> > Regards,
> > Serge...
> >
> > On Sat, Dec 1, 2018 at 5:28 PM Michael Ghen <mike@mikeghen.com
> > <ma...@mikeghen.com>> wrote:
> >
> > I think you got back to me in another thread. I was able to get this
> > sorted out, final entry point script:
> > https://github.com/mikeghen/unomi-docker/blob/master/entrypoint.sh
> >
> > Also added a wait for ElasticSearch to startup which solved a lot
> > of problems I was having.
> >
> > I put out a PR to add a Running Unomi in Docker tutorial to the
> > resources page BTW:
> > https://github.com/apache/incubator-unomi-site/pull/12
> >
> > I shared some of the work I've done with Unomi with some of the
> > senior software engineers on our team and they were impressed with
> > the tool.
> >
> > On Sat, Dec 1, 2018 at 10:12 AM Serge Huber <shuber@apache.org
> > <ma...@apache.org>> wrote:
> >
> > Hello Michael,
> >
> > I thought I had already replied to this question, but you can
> start
> > with the command line parameter :
> >
> > -Dunomi.autoStart=true
> >
> > and that way you won't have to wait for the sleep 60 since you
> won't
> > have to issue the unomi:start command anymore.
> >
> > Regards,
> > Serge...
> > On Sat, Nov 17, 2018 at 5:37 PM Michael Ghen <mike@mikeghen.com
> > <ma...@mikeghen.com>> wrote:
> > >
> > > Ok, I believe I resolved my issue by disabling xpack security
> > "xpack.security.enabled=false." Is there any way to get a better
> > error logging from ES connection failures?
> > >
> > > I'd still like to find a better way to start Unomi than what
> > I'm doing with "sleep 60" if anyone has any ideas.
> > >
> > > On Sat, Nov 17, 2018 at 9:44 AM Michael Ghen
> > <mike@mikeghen.com <ma...@mikeghen.com>> wrote:
> > >>
> > >> Thanks JB, I looked at that and based my image on your
> > Dockerfile. That was really helpful to get the image setup. I
> > can't figure out how to start Karaf but I can figure out how to
> > start Unomi. I looked into how to run commands on boot, I tried
> > something like this:
> >
> https://stackoverflow.com/questions/26434360/script-karaf-shell-commands
> > >>
> > >> This is what I have in my startup script, does this look the
> > the right way to start and run Unomi in the container:
> > >>
> > >> #!/bin/sh
> > >> $KARAF_HOME/bin/start
> > >> sleep 60
> > >> $KARAF_HOME/bin/client "unomi:start"
> > >> echo "Started Unomi"
> > >> tail -f $KARAF_HOME/data/log/karaf.log
> > >>
> > >>
> > >> On Sat, Nov 17, 2018 at 1:20 AM Jean-Baptiste Onofré
> > <jb@nanthrax.net <ma...@nanthrax.net>> wrote:
> > >>>
> > >>> Hi Michael,
> > >>>
> > >>> I blogged about Docker with Apache Karaf:
> > >>>
> > >>> http://blog.nanthrax.net/?p=839
> > >>>
> > >>> Regards
> > >>> JB
> > >>>
> > >>> On 17/11/2018 06:18, Michael Ghen wrote:
> > >>> > Hi everyone,
> > >>> >
> > >>> > I looked into running Karaf on Docker and I feel like I
> > was able to
> > >>> > figure that out.
> > >>> >
> > >>> > I can't seem to get Unomi running though so I was hoping
> > someone here
> > >>> > might be able to help me out. I'm having two problems.
> > First, I can't
> > >>> > seem to get Unomi to start. I have a start_with_ip.sh
> > entry point script
> > >>> > which I thought would start up Unomi but it seems it's
> > not working.
> > >>> > Second, when I manually start Unomi, it can't connect to
> > Elasticsearch.
> > >>> > I'm using docker compose to run a Unomi and Elasticsearch
> > container so
> > >>> > my second problem might be docker related.
> > >>> >
> > >>> > Repo with the code I'm working on
> > >>> > here: https://github.com/mikeghen/unomi-docker
> > >>> >
> > >>> > I've put the code into a repo, once I get it working I
> > think it will be
> > >>> > a good resource to add. It's basically a requirement for
> > any system we
> > >>> > want to use that it can be run on Kubernetes so getting
> > this setup in
> > >>> > docker will help me get Unomi in production. Please, let
> > me know what
> > >>> > you think. I'm not sure what else to try to get it
> running.
> > >>> >
> > >>>
> > >>> --
> > >>> Jean-Baptiste Onofré
> > >>> jbonofre@apache.org <ma...@apache.org>
> > >>> http://blog.nanthrax.net
> > >>> Talend - http://www.talend.com
> >
>
Re: Running Unomi on Docker
Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Hi,
I can handle the "official" apache part of docker.
It has to be in a dedicated module as I did for Karaf.
By the way, in the Karaf 4.2.x update and refactoring of Unomi, I also
tested the Dockerfile generation (using the karaf plugin).
Regards
JB
On 07/04/2019 14:54, Serge Huber wrote:
>
> Hello Michael,
>
> I was thinking about your Docker work, and I would really like to have
> something like this in the Apache Unomi project. Would you consider
> submitting your Docker work as a PR in a "docker" sub-directory? I'd
> like to have the compose configuration and build upon it for the new
> environment variable support.
>
> What do you think?
>
> Regards,
> Serge...
>
> On Sat, Dec 1, 2018 at 5:28 PM Michael Ghen <mike@mikeghen.com
> <ma...@mikeghen.com>> wrote:
>
> I think you got back to me in another thread. I was able to get this
> sorted out, final entry point script:
> https://github.com/mikeghen/unomi-docker/blob/master/entrypoint.sh
>
> Also added a wait for ElasticSearch to startup which solved a lot
> of problems I was having.
>
> I put out a PR to add a Running Unomi in Docker tutorial to the
> resources page BTW:
> https://github.com/apache/incubator-unomi-site/pull/12
>
> I shared some of the work I've done with Unomi with some of the
> senior software engineers on our team and they were impressed with
> the tool.
>
> On Sat, Dec 1, 2018 at 10:12 AM Serge Huber <shuber@apache.org
> <ma...@apache.org>> wrote:
>
> Hello Michael,
>
> I thought I had already replied to this question, but you can start
> with the command line parameter :
>
> -Dunomi.autoStart=true
>
> and that way you won't have to wait for the sleep 60 since you won't
> have to issue the unomi:start command anymore.
>
> Regards,
> Serge...
> On Sat, Nov 17, 2018 at 5:37 PM Michael Ghen <mike@mikeghen.com
> <ma...@mikeghen.com>> wrote:
> >
> > Ok, I believe I resolved my issue by disabling xpack security
> "xpack.security.enabled=false." Is there any way to get a better
> error logging from ES connection failures?
> >
> > I'd still like to find a better way to start Unomi than what
> I'm doing with "sleep 60" if anyone has any ideas.
> >
> > On Sat, Nov 17, 2018 at 9:44 AM Michael Ghen
> <mike@mikeghen.com <ma...@mikeghen.com>> wrote:
> >>
> >> Thanks JB, I looked at that and based my image on your
> Dockerfile. That was really helpful to get the image setup. I
> can't figure out how to start Karaf but I can figure out how to
> start Unomi. I looked into how to run commands on boot, I tried
> something like this:
> https://stackoverflow.com/questions/26434360/script-karaf-shell-commands
> >>
> >> This is what I have in my startup script, does this look the
> the right way to start and run Unomi in the container:
> >>
> >> #!/bin/sh
> >> $KARAF_HOME/bin/start
> >> sleep 60
> >> $KARAF_HOME/bin/client "unomi:start"
> >> echo "Started Unomi"
> >> tail -f $KARAF_HOME/data/log/karaf.log
> >>
> >>
> >> On Sat, Nov 17, 2018 at 1:20 AM Jean-Baptiste Onofré
> <jb@nanthrax.net <ma...@nanthrax.net>> wrote:
> >>>
> >>> Hi Michael,
> >>>
> >>> I blogged about Docker with Apache Karaf:
> >>>
> >>> http://blog.nanthrax.net/?p=839
> >>>
> >>> Regards
> >>> JB
> >>>
> >>> On 17/11/2018 06:18, Michael Ghen wrote:
> >>> > Hi everyone,
> >>> >
> >>> > I looked into running Karaf on Docker and I feel like I
> was able to
> >>> > figure that out.
> >>> >
> >>> > I can't seem to get Unomi running though so I was hoping
> someone here
> >>> > might be able to help me out. I'm having two problems.
> First, I can't
> >>> > seem to get Unomi to start. I have a start_with_ip.sh
> entry point script
> >>> > which I thought would start up Unomi but it seems it's
> not working.
> >>> > Second, when I manually start Unomi, it can't connect to
> Elasticsearch.
> >>> > I'm using docker compose to run a Unomi and Elasticsearch
> container so
> >>> > my second problem might be docker related.
> >>> >
> >>> > Repo with the code I'm working on
> >>> > here: https://github.com/mikeghen/unomi-docker
> >>> >
> >>> > I've put the code into a repo, once I get it working I
> think it will be
> >>> > a good resource to add. It's basically a requirement for
> any system we
> >>> > want to use that it can be run on Kubernetes so getting
> this setup in
> >>> > docker will help me get Unomi in production. Please, let
> me know what
> >>> > you think. I'm not sure what else to try to get it running.
> >>> >
> >>>
> >>> --
> >>> Jean-Baptiste Onofré
> >>> jbonofre@apache.org <ma...@apache.org>
> >>> http://blog.nanthrax.net
> >>> Talend - http://www.talend.com
>