[GitHub] [incubator-tvm] merrymercy edited a comment on issue #6869: [Relay][Ansor] cannot find a working schedule for certain tasks

[GitBox <gi...@apache.org>]

merrymercy edited a comment on issue #6869:
URL: https://github.com/apache/incubator-tvm/issues/6869#issuecomment-723357031


   It seems you are using our dev branch. I did some debugging and found that the problem is because the weight tensor in your dense layer is too large (the shape is (25088, 4096)).
   It causes some problems in the RPC copy.
   You can apply this diff in the `Ansor-dev` repo to fix the problem.
   ```diff
   diff --git a/python/tvm/ansor/measure.py b/python/tvm/ansor/measure.py
   index 7d06a5d96..93c293a5f 100644
   --- a/python/tvm/ansor/measure.py
   +++ b/python/tvm/ansor/measure.py
   @@ -477,7 +477,9 @@ def rpc_run_worker(index):
                        if get_special_buffer(arg.name) is not None:
                            args.append(ndarray.array(get_special_buffer(arg.name)))
                        else:
   -                        args.append(ndarray.non_empty(get_const_tuple(arg.shape), arg.dtype, ctx))
   +                        #args.append(ndarray.non_empty(get_const_tuple(arg.shape), arg.dtype, ctx))
   +                        tmp = ndarray.empty(get_const_tuple(arg.shape), arg.dtype, ctx)
   +                        args.append(ndarray.array(tmp, ctx=ctx))
                    ctx.sync()
   
                    # retry until the coefficient of variation is small enough
   ```


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org