[GitHub] rob05c edited a comment on issue #3056: Add experimental end-to-end test framework

[GitBox <gi...@apache.org>]

rob05c edited a comment on issue #3056: Add experimental end-to-end test framework
URL: https://github.com/apache/trafficcontrol/pull/3056#issuecomment-442862899
 
 
   I didn't look at `autest` in particular, but I did look at a number of others. This does use `go test`, which gives us a limited framework and does some of the basic work for us. I'm not opposed to `auttest`, but I'm not sure what the benefits would be? It looks like it's more oriented to the command line, as opposed to code. Which again, I don't have a strong opinion either way, if there's an advantage.
   
   I did look at several HTTP-level frameworks (Selenium, Katalon, SoapUI). I was actually really hoping we could use one of them, to reduce writing framework-level stuff. But I came to the conclusion that there are enough CDN-specific things we'd want to test, that any framework at that level would either be incapable of, or we'd end up using its scripting language to essentially write our own framework within in.
   
   When I say "CDN-specific", I mean things like verifying a DNS DS got a direct IP to the cache from a host lookup, or that a video could play. A lot of it is actually more network-specific, if we could find a good "network e2e test framework" that might work; but I didn't see one. Likewise for video.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services