[GitHub] yaoliclshlmch opened a new pull request #2936: Yaoli/add integration topology test

[GitBox <gi...@apache.org>]

yaoliclshlmch opened a new pull request #2936: Yaoli/add integration topology test
URL: https://github.com/apache/incubator-heron/pull/2936
 
 
   This test aims to test the launched topology structure correctness. The previous integration tests are focusing on the data correctness by fetching the real output data and comparing it with the expected output results, which is functional black box testing. For the topology structure test, white box testing should be used which means the test platform is aware of the internal topology structures. 
   
   Topology structure test here includes the following aspects:
   1. Topology graph
           a. components: spout type, bolt type and their parallelism;
           b. connectivity: data stream and connection correctness;
   2. Instance states (only in stateful processing): loaded states in target rollback checkpoint.
   
   For now, we focus on the implementation of topology component and connectivity, and the instance state test will be realized in the future.
   
   Test cases:
   1. Topology submission
   3. Spouts/bolts parallelism scale up
   4. Spouts/bolts parallelism scale down
   5. Spouts/bolts parallelism scale up and down
   2. Topology deactivation and activation
   6. container failure and recovery
   
   Running it locally:
   scripts/run_integration_topology_test.sh

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services