You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@tvm.apache.org by GitBox <gi...@apache.org> on 2021/02/28 00:58:44 UTC
[GitHub] [tvm] tqchen opened a new issue #7548: [TEST][FLAKY] test_auo_scheduler_layout_rewrite
tqchen opened a new issue #7548:
URL: https://github.com/apache/tvm/issues/7548
```
=================================== FAILURES ===================================
__________ test_correctness_layout_rewrite_rewrite_for_preTransformed __________
@tvm.testing.requires_llvm
def test_correctness_layout_rewrite_rewrite_for_preTransformed():
N = 128
target = tvm.target.Target("llvm")
task = auto_scheduler.SearchTask(func=matmul_auto_scheduler_test, args=(N, N, N), target=target)
dag = task.compute_dag
with tempfile.NamedTemporaryFile() as fp:
log_file = fp.name
search_policy = auto_scheduler.SketchPolicy(task)
measure_ctx = auto_scheduler.LocalRPCMeasureContext()
tuning_options = auto_scheduler.TuningOptions(
num_measure_trials=2,
runner=measure_ctx.runner,
verbose=2,
measure_callbacks=[auto_scheduler.RecordToFile(log_file)],
)
task.tune(tuning_options, search_policy=search_policy)
inp, _ = auto_scheduler.load_best_record(log_file, task.workload_key, target)
s, bufs = dag.apply_steps_from_state(
> inp.state, layout_rewrite=auto_scheduler.LayoutRewriteOption.REWRITE_FOR_PRE_TRANSFORMED
)
E AttributeError: 'NoneType' object has no attribute 'state'
tests/python/unittest/test_auto_scheduler_layout_rewrite.py:89: AttributeError
=============================== warnings summary ===============================
```
https://ci.tlcpack.ai/blue/organizations/jenkins/tvm/detail/main/625/pipeline
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] merrymercy commented on issue #7548: [TEST][FLAKY] test_auo_scheduler_layout_rewrite
Posted by GitBox <gi...@apache.org>.
merrymercy commented on issue #7548:
URL: https://github.com/apache/tvm/issues/7548#issuecomment-787931882
We can use this tuning option to make sure we always get a valid schedule. It will try at most 100 schedules but stops immediately when we get a valid one.
https://github.com/apache/tvm/blob/51dc332646d90b77ae29e2e2dbe21f40008a0082/tests/python/relay/test_auto_scheduler_tuning.py#L42-L44
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] jcf94 commented on issue #7548: [TEST][FLAKY] test_auo_scheduler_layout_rewrite
Posted by GitBox <gi...@apache.org>.
jcf94 commented on issue #7548:
URL: https://github.com/apache/tvm/issues/7548#issuecomment-789624576
How about to set a smaller N?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] tqchen commented on issue #7548: [TEST][FLAKY] test_auo_scheduler_layout_rewrite
Posted by GitBox <gi...@apache.org>.
tqchen commented on issue #7548:
URL: https://github.com/apache/tvm/issues/7548#issuecomment-787212457
cc @comaniac @merrymercy
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] comaniac commented on issue #7548: [TEST][FLAKY] test_auo_scheduler_layout_rewrite
Posted by GitBox <gi...@apache.org>.
comaniac commented on issue #7548:
URL: https://github.com/apache/tvm/issues/7548#issuecomment-789934495
Combining the above ideas, I'll file a PR to
1. Reduce the workload size (i.e., N) from 128x128 to 16x16.
2. Enlarge trial number to 100 with early_stopping=1.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] masahi commented on issue #7548: [TEST][FLAKY] test_auo_scheduler_layout_rewrite
Posted by GitBox <gi...@apache.org>.
masahi commented on issue #7548:
URL: https://github.com/apache/tvm/issues/7548#issuecomment-787524889
I remember we had this problem before @jcf94
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] comaniac commented on issue #7548: [TEST][FLAKY] test_auo_scheduler_layout_rewrite
Posted by GitBox <gi...@apache.org>.
comaniac commented on issue #7548:
URL: https://github.com/apache/tvm/issues/7548#issuecomment-788140133
I'm afraid that this would make the CI time longer especially on slower machines such as i386.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] comaniac commented on issue #7548: [TEST][FLAKY] test_auo_scheduler_layout_rewrite
Posted by GitBox <gi...@apache.org>.
comaniac commented on issue #7548:
URL: https://github.com/apache/tvm/issues/7548#issuecomment-787409566
This happens when no valid schedules can be applied (`load_best_record` returns None in this case). Maybe in the i386 machine it's easy to get timeout and results in this error. We could consider either of the following:
A. Only perform this test on x86.
B. Improve this test by mocking a valid record.
@merrymercy which one do you prefer or do you have other suggestions?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] comaniac closed issue #7548: [TEST][FLAKY] test_auo_scheduler_layout_rewrite
Posted by GitBox <gi...@apache.org>.
comaniac closed issue #7548:
URL: https://github.com/apache/tvm/issues/7548
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] merrymercy edited a comment on issue #7548: [TEST][FLAKY] test_auo_scheduler_layout_rewrite
Posted by GitBox <gi...@apache.org>.
merrymercy edited a comment on issue #7548:
URL: https://github.com/apache/tvm/issues/7548#issuecomment-787931882
We can use this tuning option to make sure we always get a valid schedule. It will try at most 100 schedules but stops immediately when we get a valid one.
https://github.com/apache/tvm/blob/51dc332646d90b77ae29e2e2dbe21f40008a0082/tests/python/relay/test_auto_scheduler_tuning.py#L41-L44
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org