You are viewing a plain text version of this content. The canonical link for it is here.
Posted to discuss-archive@tvm.apache.org by yj shi via TVM Discuss <no...@discuss.tvm.ai> on 2020/04/14 04:36:11 UTC

[TVM Discuss] [Questions] Use smaller input size for Relay execute


I was trying to run different models in Relay and there is one issue with the executor.evaluate() API. TVM will only take the input with a shape exactly like the input shape of the model, instead of a smaller batch size. And that is commonly acceptable on other frameworks like Keras or PyTorch. For example, instead of doing:

`tvm_out = executor.evaluate()(tvm.nd.array(input_data), **params)`

can we do 

`tvm_out = executor.evaluate()(tvm.nd.array(input_data[:1000]), **params)`

in TVM?





---
[Visit Topic](https://discuss.tvm.ai/t/use-smaller-input-size-for-relay-execute/6357/1) to respond.

You are receiving this because you enabled mailing list mode.

To unsubscribe from these emails, [click here](https://discuss.tvm.ai/email/unsubscribe/d27b796d593c71cf882480c3adc737a55c36942e0e79322c16f8b297587580bb).