Re: MULTI DEPLOYMENT

[glenn opdycke-hansen <gl...@gmail.com>]

Steve,
I have been looking at using Ant for application deployment to multiple servers.
I see there is a known problem with ant 1.6.5 where a sshexec request
will close stdout.  This can be patched, but this problem is pretty
serious since multiple sshexec requests would be needed.
I have been looking at the documentation for SmartFrog.  Can you point
out a doc that describes the issues of deployment?
This would include distribution of build files, execution of
deployment scripts, configuration, and logging/notification?

Thanks much!
--glenn

On 1/4/06, Steve Loughran <st...@apache.org> wrote:
...
> If it is more complex you have just entered the world of systems
> management. This is no longer a build-time step, it is something that
> operations want to get involved in too. SmartFrog (http://smartfrog.org)
> is one option. Others are
>
> -the premium big-system management tools like the Microsoft Datacenter
> thing,
> -linux  rpms (that is, package everything as rpms and use your server's
> RPM tools to install stuff).
> -cfengine (unix/linux only)
> -bcfg
> -lcfg (lcfg.org)
>
> Large-Scale CM is still a research topic. 3 machines is solved. 500+
> nodes is considered leading edge.
> http://config.sage.org/faq.html
> http://homepages.informatics.ed.ac.uk/group/lssconf/
>
> Before you try any of this, find out who will be in charge of keeping
> the machine operational and talk to them. Find out what they
> like/dislike, and work with them to come up with a solution that
> everyone is happy with.
>
>
> -Steve
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@ant.apache.org
> For additional commands, e-mail: user-help@ant.apache.org
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@ant.apache.org
For additional commands, e-mail: user-help@ant.apache.org

Re: MULTI DEPLOYMENT

[glenn opdycke-hansen <gl...@gmail.com>]

I see the changes in the following.  It appears that the change is
integrated.  I have tried this change and it worked for me.

Log of
/ant/core/trunk/src/main/org/apache/tools/ant/taskdefs/optional/ssh/SSHExec.java
Revision 278545  - (view) (download) (as text)     - [select for diffs]
  Modified  Wed Aug 31 19:39:14 2005 UTC (4 months, 1 week ago) by
mbenson


On 1/12/06, Steve Loughran <st...@apache.org> wrote:
> glenn opdycke-hansen wrote:
> > Steve,
> > I have been looking at using Ant for application deployment to multiple
servers.
> > I see there is a known problem with ant 1.6.5 where a sshexec request
> > will close stdout.  This can be patched, but this problem is pretty
> > serious since multiple sshexec requests would be needed.
>
> Do you know if it has been fixed in ant1.7? If not, now is the time to
> get a patch in.
>

Re: MULTI DEPLOYMENT

[Steve Loughran <st...@apache.org>]

glenn opdycke-hansen wrote:
> Steve,
> I have been looking at using Ant for application deployment to multiple servers.
> I see there is a known problem with ant 1.6.5 where a sshexec request
> will close stdout.  This can be patched, but this problem is pretty
> serious since multiple sshexec requests would be needed.

Do you know if it has been fixed in ant1.7? If not, now is the time to 
get a patch in.

> I have been looking at the documentation for SmartFrog.  Can you point
> out a doc that describes the issues of deployment?

I would have a look at the overview presentation we gave at OSCon:
http://www.hpl.hp.com/research/smartfrog/presentations/Taming_deployment_with_SmartFrog.pdf

> This would include distribution of build files, execution of
> deployment scripts, configuration, and logging/notification?

Probably the best paper on how to use ant for large scale deployment is 
the "Advanced deployment" chapter in Java Development with Ant, in which 
we covered how to use property files to control uploading of build files 
to different targets, then remotely executing them. I probably used 
ftp+telnet though, not scp/ssh.

Smartfrog is not a scripting tool; you are really trying to describe the 
static system state; which things should be running in a correctly 
functioning system. It just so happens that to deploy some thing you 
need to run scripts or do other actions in a sequence, so there are some 
workflow components you deploy to run stuff in a sequence, handle 
failures etc. A lot of the examples (and real stuff)  has tended to drop 
down to unix shell scripts to do stuff like install apache, mysql, etc. 
One of the things I did after joining the project was try and add more 
platform independence, with constructs like Ant's file type, and a 
better java runner, for java execution (that is a bit unfair, as 
smartfrog has always been really good at deploying stuff in new 
processes, but I needed separate process execution to escape from the 
security restrictions of signed-code-only).

Logging and notification. hmmm. Logging is done, though logging in a 
distributed system is part of the ongoing problem of "how do you monitor 
distributed systems properly". It helps to have all the clocks in sync, 
otherwise it becomes hard to determine the 'absolute' order of things 
happening. Realistically, there is no absolute order of events in a 
distributed system, we are all radio astronomers looking at distant 
events in the past, trying to work out why a server disapperaed for no 
apparent reason.

-steve


---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@ant.apache.org
For additional commands, e-mail: user-help@ant.apache.org