[GitHub] [incubator-tvm] gussmith23 opened a new issue #4348: [Relay] Add tests in CI which run tests based on specific Relay feature flags

[GitBox <gi...@apache.org>]

gussmith23 opened a new issue #4348: [Relay] Add tests in CI which run tests based on specific Relay feature flags
URL: https://github.com/apache/incubator-tvm/issues/4348
 
 
   A persistent problem in Relay is what @MarisaKirisame calls the "split-brain" problem: the developers of Relay and the users of Relay are of two minds on how Relay works. Specifically, Relay developers want to support advanced features that didn't exist in NNVM, while Relay users often treat Relay as NNVM. For example, Relay users will write Relay passes that work like NNVM over Relay features that also existed in NNVM, and will break/behave incorrectly over new Relay features.
   
   In response to this problem, @MarisaKirisame has added [a feature manager](https://github.com/apache/incubator-tvm/pull/3238), which users can use to check the features of a Relay program. The associated issue also discusses modifying the pass manager such that each pass would need to specify what features a pass can handle, what features a pass may add, and which features a pass may remove. 
   
   We'd like to start adding tests into the CI which use Relay's feature sets to test newly added passes. We will test new passes on Relay programs with a variety of feature sets, to test whether they break programs which they claim they should support, given their feature set. New passes will only be tested on Relay programs with features they explicitly support. These new CI tests should help us ensure that pass developers appropriately mark which features their passes support and don't support. 
   
   **Task list**
   - [ ] Collect programs which have different feature sets
     + list features here...
   - [ ] Create infrastructure for testing all new passes

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services