You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@tvm.apache.org by GitBox <gi...@apache.org> on 2022/08/20 00:54:30 UTC

[GitHub] [tvm] shingjan opened a new issue, #12511: [Flaky Test] `tests/python/contrib/test_ethosu/test_codegen.py::test_binary_add_with_non_4d_shapes[ifm_shape0-ifm2_shape0-ethos-u55-32]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_binary_add_with_non_4d_shapes[ifm_shape0-ifm2_shape0-ethos-u55-256]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_tflite_squeeze[ifm_shape2-None-ethos-u55-256]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_identity_codegen[1-0-1-0-ifm_shape3-ethos-u55-64]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_identity_codegen[0.015-3-0.2-5-ifm_shape3-ethos-u55-128]`

shingjan opened a new issue, #12511:
URL: https://github.com/apache/tvm/issues/12511

   These tests were found to be flaky (intermittently failing on `main` or failed in a PR with unrelated changes). See [the docs](https://github.com/apache/tvm/blob/main/docs/contribute/ci.rst#handling-flaky-failures) for details.
   
   ### Tests(s)
   
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_binary_add_with_non_4d_shapes[ifm_shape0-ifm2_shape0-ethos-u55-32]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_binary_add_with_non_4d_shapes[ifm_shape0-ifm2_shape0-ethos-u55-256]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_tflite_squeeze[ifm_shape2-None-ethos-u55-256]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_identity_codegen[1-0-1-0-ifm_shape3-ethos-u55-64]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_identity_codegen[0.015-3-0.2-5-ifm_shape3-ethos-u55-128]`
   
   
   ### Jenkins Links
   
     - https://ci.tlcpack.ai/job/tvm/job/main/4084/display/redirect
     - https://ci.tlcpack.ai/job/tvm/job/main/4093/display/redirect


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [tvm] cconvey commented on issue #12511: [Flaky Test] various tests in `tests/python/contrib/test_ethosu/test_codegen.py`

Posted by GitBox <gi...@apache.org>.
cconvey commented on issue #12511:
URL: https://github.com/apache/tvm/issues/12511#issuecomment-1224235998

   Another CI failure: 
   ### Tests(s)
   
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_binary_add_with_non_4d_shapes[ifm_shape0-ifm2_shape0-ethos-u55-128]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_unary_elementwise[ifm_shape4-ABS-ethos-u55-128]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_identity_codegen[1-0-1-0-ifm_shape3-ethos-u55-256]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_tflite_slice[ifm_shape3-begin3-size3-ethos-u55-256]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_relay_reshape_codegen[ifm_shape5-new_shape5-ethos-u55-256]`
   
   ### Jenkins Links
   
     - https://ci.tlcpack.ai/job/tvm/job/main/4132/display/redirect


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [tvm] shingjan commented on issue #12511: [Flaky Test] `tests/python/contrib/test_ethosu/test_codegen.py::test_binary_add_with_non_4d_shapes[ifm_shape0-ifm2_shape0-ethos-u55-32]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_binary_add_with_non_4d_shapes[ifm_shape0-ifm2_shape0-ethos-u55-256]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_tflite_squeeze[ifm_shape2-None-ethos-u55-256]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_identity_codegen[1-0-1-0-ifm_shape3-ethos-u55-64]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_identity_codegen[0.015-3-0.2-5-ifm_shape3-ethos-u55-128]`

Posted by GitBox <gi...@apache.org>.
shingjan commented on issue #12511:
URL: https://github.com/apache/tvm/issues/12511#issuecomment-1222791397

   Hi @areusch would that be possible that we keep this open until Luke can take a look? I believe David's PR only mitigate the issue instead of fixing it. Thanks!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [tvm] areusch closed issue #12511: [Flaky Test] `tests/python/contrib/test_ethosu/test_codegen.py::test_binary_add_with_non_4d_shapes[ifm_shape0-ifm2_shape0-ethos-u55-32]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_binary_add_with_non_4d_shapes[ifm_shape0-ifm2_shape0-ethos-u55-256]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_tflite_squeeze[ifm_shape2-None-ethos-u55-256]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_identity_codegen[1-0-1-0-ifm_shape3-ethos-u55-64]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_identity_codegen[0.015-3-0.2-5-ifm_shape3-ethos-u55-128]`

Posted by GitBox <gi...@apache.org>.
areusch closed issue #12511: [Flaky Test] `tests/python/contrib/test_ethosu/test_codegen.py::test_binary_add_with_non_4d_shapes[ifm_shape0-ifm2_shape0-ethos-u55-32]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_binary_add_with_non_4d_shapes[ifm_shape0-ifm2_shape0-ethos-u55-256]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_tflite_squeeze[ifm_shape2-None-ethos-u55-256]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_identity_codegen[1-0-1-0-ifm_shape3-ethos-u55-64]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_identity_codegen[0.015-3-0.2-5-ifm_shape3-ethos-u55-128]`
URL: https://github.com/apache/tvm/issues/12511


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [tvm] lhutton1 commented on issue #12511: [Flaky Test] `tests/python/contrib/test_ethosu/test_codegen.py::test_binary_add_with_non_4d_shapes[ifm_shape0-ifm2_shape0-ethos-u55-32]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_binary_add_with_non_4d_shapes[ifm_shape0-ifm2_shape0-ethos-u55-256]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_tflite_squeeze[ifm_shape2-None-ethos-u55-256]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_identity_codegen[1-0-1-0-ifm_shape3-ethos-u55-64]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_identity_codegen[0.015-3-0.2-5-ifm_shape3-ethos-u55-128]`

Posted by GitBox <gi...@apache.org>.
lhutton1 commented on issue #12511:
URL: https://github.com/apache/tvm/issues/12511#issuecomment-1222608515

   Thanks for reporting @shingjan, I hope to find some time to investigate soon


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [tvm] cconvey commented on issue #12511: [Flaky Test] various tests in `tests/python/contrib/test_ethosu/test_codegen.py`

Posted by GitBox <gi...@apache.org>.
cconvey commented on issue #12511:
URL: https://github.com/apache/tvm/issues/12511#issuecomment-1227359596

   Just FYI, another occurrence of this CI failure occurred _before_ the bugfix landed on `main`: https://ci.tlcpack.ai/blue/organizations/jenkins/tvm/detail/main/4137/pipeline


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [tvm] cconvey commented on issue #12511: [Flaky Test] various tests in `tests/python/contrib/test_ethosu/test_codegen.py`

Posted by GitBox <gi...@apache.org>.
cconvey commented on issue #12511:
URL: https://github.com/apache/tvm/issues/12511#issuecomment-1224234001

   Another CI failure: 
   These tests were found to be flaky (intermittently failing on `main` or failed in a PR with unrelated changes). See [the docs](https://github.com/apache/tvm/blob/main/docs/contribute/ci.rst#handling-flaky-failures) for details.
   
   ### Tests(s)
   
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_unary_elementwise[ifm_shape4-ABS-ethos-u55-64]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_binary_add_with_non_4d_shapes[ifm_shape0-ifm2_shape0-ethos-u55-64]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_identity_codegen[1-0-1-0-ifm_shape3-ethos-u55-128]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_tflite_slice[ifm_shape3-begin3-size3-ethos-u55-32]`
   
   ### Jenkins Links
   
     - https://ci.tlcpack.ai/job/tvm/job/main/4117/display/redirect


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [tvm] leandron closed issue #12511: [Flaky Test] various tests in `tests/python/contrib/test_ethosu/test_codegen.py`

Posted by GitBox <gi...@apache.org>.
leandron closed issue #12511: [Flaky Test] various tests in `tests/python/contrib/test_ethosu/test_codegen.py`
URL: https://github.com/apache/tvm/issues/12511


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [tvm] cconvey commented on issue #12511: [Flaky Test] various tests in `tests/python/contrib/test_ethosu/test_codegen.py`

Posted by GitBox <gi...@apache.org>.
cconvey commented on issue #12511:
URL: https://github.com/apache/tvm/issues/12511#issuecomment-1224231899

   Another CI failure: 
   ### Tests(s)
   
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_binary_add_with_non_4d_shapes[ifm_shape0-ifm2_shape0-ethos-u55-32]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_binary_add_with_non_4d_shapes[ifm_shape0-ifm2_shape0-ethos-u55-256]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_identity_codegen[1-0-1-0-ifm_shape3-ethos-u55-64]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_tflite_squeeze[ifm_shape2-None-ethos-u55-256]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_identity_codegen[0.015-3-0.2-5-ifm_shape3-ethos-u55-128]`
   
   ### Jenkins Links
   
     - https://ci.tlcpack.ai/job/tvm/job/main/4122/display/redirect


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [tvm] areusch commented on issue #12511: [Flaky Test] `tests/python/contrib/test_ethosu/test_codegen.py::test_binary_add_with_non_4d_shapes[ifm_shape0-ifm2_shape0-ethos-u55-32]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_binary_add_with_non_4d_shapes[ifm_shape0-ifm2_shape0-ethos-u55-256]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_tflite_squeeze[ifm_shape2-None-ethos-u55-256]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_identity_codegen[1-0-1-0-ifm_shape3-ethos-u55-64]`, `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_identity_codegen[0.015-3-0.2-5-ifm_shape3-ethos-u55-128]`

Posted by GitBox <gi...@apache.org>.
areusch commented on issue #12511:
URL: https://github.com/apache/tvm/issues/12511#issuecomment-1222965187

   oh whooops. that was not intentional!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [tvm] cconvey commented on issue #12511: [Flaky Test] various tests in `tests/python/contrib/test_ethosu/test_codegen.py`

Posted by GitBox <gi...@apache.org>.
cconvey commented on issue #12511:
URL: https://github.com/apache/tvm/issues/12511#issuecomment-1224236581

   Another CI failure: 
   ### Tests(s)
   
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_binary_add_with_non_4d_shapes[ifm_shape0-ifm2_shape0-ethos-u55-128]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_relay_reshape_codegen[ifm_shape5-new_shape5-ethos-u55-256]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_unary_elementwise[ifm_shape4-ABS-ethos-u55-128]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_identity_codegen[1-0-1-0-ifm_shape3-ethos-u55-256]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_tflite_slice[ifm_shape3-begin3-size3-ethos-u55-256]`
   
   ### Jenkins Links
   
     - https://ci.tlcpack.ai/job/tvm/job/main/4135/display/redirect


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [tvm] cconvey commented on issue #12511: [Flaky Test] various tests in `tests/python/contrib/test_ethosu/test_codegen.py`

Posted by GitBox <gi...@apache.org>.
cconvey commented on issue #12511:
URL: https://github.com/apache/tvm/issues/12511#issuecomment-1224213513

   FYI there's a more recent CI failure that looks related.  Here's the filled-out flaky-test details, but I haven't created a new Issue yet:
   
   These tests were found to be flaky (intermittently failing on `main` or failed in a PR with unrelated changes). See [the docs](https://github.com/apache/tvm/blob/main/docs/contribute/ci.rst#handling-flaky-failures) for details.
   
   ### Tests(s)
   
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_unary_elementwise[ifm_shape4-ABS-ethos-u55-32]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_tflite_slice[ifm_shape3-begin3-size3-ethos-u55-128]`
   
   ### Jenkins Links
   
     - https://ci.tlcpack.ai/job/tvm/job/main/4133/display/redirect


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [tvm] cconvey commented on issue #12511: [Flaky Test] various tests in `tests/python/contrib/test_ethosu/test_codegen.py`

Posted by GitBox <gi...@apache.org>.
cconvey commented on issue #12511:
URL: https://github.com/apache/tvm/issues/12511#issuecomment-1224235195

   Another CI failure: 
   These tests were found to be flaky (intermittently failing on `main` or failed in a PR with unrelated changes). See [the docs](https://github.com/apache/tvm/blob/main/docs/contribute/ci.rst#handling-flaky-failures) for details.
   
   ### Tests(s)
   
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_identity_codegen[1-0-1-0-ifm_shape3-ethos-u55-256]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_ethosu_unary_elementwise[ifm_shape4-ABS-ethos-u55-128]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_relay_reshape_codegen[ifm_shape5-new_shape5-ethos-u55-256]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_binary_add_with_non_4d_shapes[ifm_shape0-ifm2_shape0-ethos-u55-128]`
     - `tests/python/contrib/test_ethosu/test_codegen.py::test_tflite_slice[ifm_shape3-begin3-size3-ethos-u55-256]`
   
   ### Jenkins Links
   
     - https://ci.tlcpack.ai/job/tvm/job/main/4131/display/redirect


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org