[users@httpd] httpd log file analysis using SnapLogic

[Michael Pittaro <mi...@snaplogic.org>]

We have released a SnapLogic package which implements Apache log file
aggregation using the SnapLogic integration server, which may be of
interest to
the Apache user community.

The download is available at :
http://packages.snaplogic.org/packages/ApacheLogs/,
and depends on themain SnapLogic server (currently in Beta) available from
http://www.snaplogic.org.

The package implements on-the-fly merging of multiple Apache log files,
which
may be located on different servers. The individual log files are
assumed to be
sorted by each line's time stamp. The resulting output of the merge
operation
will be equally sorted by time.

Key features:

    * Apache log files of the 'common' and 'combined' format are supported.
      If the virtual host is indicated as an additional element (first
in each
      log line), then the formats are called 'vcommon' and 'vcombined'.

    * Output is made available as HTML, which can be viewed in a web
browser.

    * The aggregation is 'live': Everytime the data is requested the
individual
      log files are merged again, thereby allowing new entries to be
reflected
      in the merged output.

    * A component for the writing of log files is provided as well, allowing
      you to create a file version of the merged output, which may then
be used
      by other log analysis packages.

    * A powerful installation script is provided, which allows you to create
      all the necessary resources quickly and easily. The script is driven
      entirely via command line parameters, which allows it to be
integrated into
      your already existing management infrastructure more easily.

The processing logic can be used as-is, or it can be customized
to suit your needs by modifying the SnapLogic resource definitions.

This is a first pass at this functionality within SnapLogic, and we're
interested in any feedback on the package, or suggested enhancements.

Thanks,

mike

-- 
mikeyp@snaplogic.org            http://www.snaplogic.org


---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org