You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@tvm.apache.org by GitBox <gi...@apache.org> on 2021/03/12 13:56:51 UTC
[GitHub] [tvm] SubjectNoi opened a new issue #7650: [Relay] relay.build error when setting attributes of IR Module.
SubjectNoi opened a new issue #7650:
URL: https://github.com/apache/tvm/issues/7650
TVM Version: 0.8
OS: Ubuntu 18.04
I encountered a problem when I use `relay.build` to build the context from IR Module **AFTER I SET ATTRIBUTE OF THE IR MODULE** by `mod['main'] = mod['main'].with_attr("Attr_Key", "Attr_Value")` (Since I want to use my own CodeGen by using `mod['main'] = mod['main'].with_attr("compiler", "my_code_gen")` ), the onnx model I use is bertsquad-8.onnx with dynamic shape downloaded at:
Following script can reproduce my problem:
```
1: from tvm import relay
2: import tvm
3: from tvm.contrib.debugger import debug_runtime as graph_runtime
4: import onnx
5:
6: model = onnx.load("bertsquad-8.onnx")
7: target = 'c'
8: shape_dict = {
9: "unique_ids_raw_output___9:0" : (1,),
10: "input_ids:0": (1, 256),
11: "input_mask:0": (1, 256),
12: "segment_ids:0": (1, 256)
13: }
14: mod, params = relay.frontend.from_onnx(model, shape_dict)
15: mod['main'] = mod['main'].with_attr("Compiler", "My_Code_Gen") # Without this line, the program run normally
16: mod = relay.transform.InferType()(mod)
17: json, lib, _ = relay.build(mod, target=target, params=params)
```
Once I add Line 15, I encounter following error:
```
Traceback (most recent call last):
File "run.py", line 59, in <module>
json, lib, _ = relay.build(mod, target=target, params=params)
File "/data/tvm/python/tvm/relay/build_module.py", line 276, in build
graph_json, mod, params = bld_mod.build(mod, target, target_host, params)
File "/data/tvm/python/tvm/relay/build_module.py", line 139, in build
self._build(mod, target, target_host)
File "/data/tvm/python/tvm/_ffi/_ctypes/packed_func.py", line 237, in __call__
raise get_last_ffi_error()
tvm._ffi.base.TVMError: Traceback (most recent call last):
[bt] (8) /data/tvm/build/libtvm.so(tvm::relay::ExprFunctor<void (tvm::RelayExpr const&)>::VisitExpr(tvm::RelayExpr const&)+0x6b) [0x7fafedc18d9b]
[bt] (7) /data/tvm/build/libtvm.so(tvm::relay::StorageAllocator::VisitExpr_(tvm::relay::CallNode const*)+0xbe) [0x7fafedbc2c9e]
[bt] (6) /data/tvm/build/libtvm.so(tvm::relay::ExprVisitor::VisitExpr(tvm::RelayExpr const&)+0x7b) [0x7fafedc6b03b]
[bt] (5) /data/tvm/build/libtvm.so(tvm::relay::ExprFunctor<void (tvm::RelayExpr const&)>::VisitExpr(tvm::RelayExpr const&)+0x6b) [0x7fafedc18d9b]
[bt] (4) /data/tvm/build/libtvm.so(tvm::relay::StorageAllocator::VisitExpr_(tvm::relay::CallNode const*)+0x1b5) [0x7fafedbc2d95]
[bt] (3) /data/tvm/build/libtvm.so(tvm::relay::StorageAllocator::CreateToken(tvm::RelayExprNode const*, bool)+0x17d) [0x7fafedbc28cd]
[bt] (2) /data/tvm/build/libtvm.so(tvm::relay::StorageAllocator::Request(tvm::relay::StorageToken*)+0x30) [0x7fafedbc1ae0]
[bt] (1) /data/tvm/build/libtvm.so(tvm::relay::StorageAllocator::GetMemorySize(tvm::relay::StorageToken*)+0x296) [0x7fafedbc15f6]
[bt] (0) /data/tvm/build/libtvm.so(+0x2f67928) [0x7fafedbbf928]
File "/data/tvm/src/relay/backend/graph_plan_memory.cc", line 292
TVMError:
---------------------------------------------------------------
An internal invariant was violated during the execution of TVM.
Please read TVM's error reporting guidelines.
More details can be found here: https://discuss.tvm.ai/t/error-reporting/7793.
---------------------------------------------------------------
Check failed: pval != nullptr == false: Cannot allocate memory symbolic tensor shape [?]
```
**But once I delete Line 15, the program act normally, I wonder how to resolve this.**
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] masahi commented on issue #7650: [Relay] relay.build error when setting attributes of IR Module.
Posted by GitBox <gi...@apache.org>.
masahi commented on issue #7650:
URL: https://github.com/apache/tvm/issues/7650#issuecomment-1008439253
The error means you need to use the VM compiler, not `relay.build()`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] masahi closed issue #7650: [Relay] relay.build error when setting attributes of IR Module.
Posted by GitBox <gi...@apache.org>.
masahi closed issue #7650:
URL: https://github.com/apache/tvm/issues/7650
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] SubjectNoi commented on issue #7650: [Relay] relay.build error when setting attributes of IR Module.
Posted by GitBox <gi...@apache.org>.
SubjectNoi commented on issue #7650:
URL: https://github.com/apache/tvm/issues/7650#issuecomment-797827057
Actually I encounter this [?] Error when I use with_attr to set any attribute of function in IR Module (e.g. Primitive)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org