TSQA replacement prototype ready for testing

[Jason Kenny <jk...@yahoo-inc.com.INVALID>]

Hi all,

I am about ready to make a pull request for the updated testing system to
replace the existing TSQA.

BUT.... Before I do I would like some others to give it this a run locally on your
setup. It would be very help for the effort to improve out testing if I
could get some help and other eyes to look at the system as is and provide
feedback.

Currently I (with help from others at Yahoo, most notably Persia Aziz for the
microserver improvements and https tests) have a number of tests ported from
TSQA done, as well as a few extra. I will be giving a talk about the new
system at the upcoming summate next week. I will be honest I have issues to
deal with yet, documentation that needs more work and feature are already
being requested as well as a few item I have to finish in the engine. 

So how can you help!

There are few areas in which you can help out!

Try running the tests!
==================

You will need a build of traffic server installed. It is easiest if you have
a build configured like ./configure --prefix /home/<user>/ats. However, this
is not required. You may have to add a "sudo" command otherwise to the
./autest.sh command below

1) Check out to tests. You can find them here:
https://bitbucket.org/dragon512/ats_tests
2) cd ats_tests/tests
3) ./autest.sh -ats-bin <location of the ats/bin directory of an install
version of ats> --sandbox ~/sb

Just verify that everything ran without crashing and most every test passes.
Feel free to report any failing tests, it should be 100% pass rate. 

If you are more advanced you can pip install the testing code directly via:
pip install
git+https://bitbucket.org/dragon512/reusable-gold-testing-system.git

to your system or your own virtual env. ( I will be updating the pip package
this week or next, so you can do "pip install autest" however, this package
is out of date on the pypi repo)

you can then run the tests in tests/gold_tests/ via running autest from that
directory or via passing it in via the -D option. ( run autest --help for
details on options)


Look at the documentation for AuTest. 
================================

It still a work in progress, and needs more examples, etc... but feedback is
most welcome. 
Given the documentation is technically a git repo, feel free to make
addition or fixes via a pull request or just drop me a line. 

You can find the documentation at:
https://bitbucket.org/dragon512/reusable-gold-testing-system/wiki/Home


Try writing a test
==============

Try adding a test, or porting over a test I have not done yet in TSQA. I
don't have documentation yet for the autest extensions for traffic server
tests yet. However, if you look at the existing tests you should be able to
figure out what you can do. Of course feel free to ping me via IRC. It does
not hurt to get more tests added :-)

That's all I have at the moment. Any suggestion, thoughts, new tests, and
fixes are welcome.

Again here are a summary of links to look at:

The existing test for ATS can be found here:
https://bitbucket.org/dragon512/ats_tests 

The Testing system can be found here:
https://bitbucket.org/dragon512/reusable-gold-testing-system 

The documentation can be found here:
https://bitbucket.org/dragon512/reusable-gold-testing-system/wiki/Home 


I look forward to meeting many of you all at the coming summate!

Also thanks to:
Thomas Jackson for his work on the current TSQA and his help and advice on
how to addressed different issues. 
James Peach for his help and advice over earlier versions of the
documentation and the prototype.

It was very helpful for me in my work.


Thanks!
Jason