You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@mxnet.apache.org by GitBox <gi...@apache.org> on 2020/11/17 04:43:28 UTC
[GitHub] [incubator-mxnet] pribadihcr opened a new issue #19550: Got error in c++ inference example when enable tensorRT
pribadihcr opened a new issue #19550:
URL: https://github.com/apache/incubator-mxnet/issues/19550
## Description
Got error in c++ inference example when enable tensorRT
### Error Message
I got the following error:
terminate called after throwing an instance of 'dmlc::Error'
what(): [12:35:05] ../../include/mxnet-cpp/symbol.hpp:260: Check failed: MXSymbolInferShapeEx(GetHandle(), keys.size(), keys.data(), arg_ind_ptr.data(), arg_shape_data.data(), &in_shape_size, &in_shape_ndim, &in_shape_data, &out_shape_size, &out_shape_ndim, &out_shape_data, &aux_shape_size, &aux_shape_ndim, &aux_shape_data, &complete) == 0 (-1 vs. 0) :
Stack trace:
[bt] (0) ./imagenet_inference(dmlc::LogMessageFatal::~LogMessageFatal()+0x75) [0x564f81675465]
[bt] (1) ./imagenet_inference(+0x20fea) [0x564f8167efea]
[bt] (2) ./imagenet_inference(+0x2bcd7) [0x564f81689cd7]
[bt] (3) ./imagenet_inference(+0x1536e) [0x564f8167336e]
[bt] (4) ./imagenet_inference(+0xc92b) [0x564f8166a92b]
[bt] (5) /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7f67780d3b97]
[bt] (6) ./imagenet_inference(+0xcf2a) [0x564f8166af2a]
### Steps to reproduce
cpp-package/example/inference$ ./imagenet_inference --symbol_file "./model/Inception-BN-symbol.json" --params_file "./model/Inception-BN-0126.params" --batch_size 16 --num_inference_batches 500 --benchmark --enableTRT
## Environment
mxnet 1.8.0.rc2
cuda-10.2
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] pribadihcr commented on issue #19550: Got error in c++ inference example when enable tensorRT
Posted by GitBox <gi...@apache.org>.
pribadihcr commented on issue #19550:
URL: https://github.com/apache/incubator-mxnet/issues/19550#issuecomment-749980326
Hi @Kh4L any help about this issue? thanks
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] barry-jin commented on issue #19550: Got error in c++ inference example when enable tensorRT
Posted by GitBox <gi...@apache.org>.
barry-jin commented on issue #19550:
URL: https://github.com/apache/incubator-mxnet/issues/19550#issuecomment-841439592
> @barry-jin does it affect the master version too?
Yes, I just tested cpp-package for master branch and the detailed stack trace is like this:
```
terminate called after throwing an instance of 'dmlc::Error'
what(): [18:55:32] ../cpp-package/include/mxnet-cpp/symbol.hpp:220: MXNetError: Check failed: it != backend_map_.end(): SubgraphProperty TensorRT is not found in SubgraphBackendRegistry
Stack trace:
File "../src/c_api/../operator/subgraph/subgraph_property.h", line 534
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] handoku edited a comment on issue #19550: Got error in c++ inference example when enable tensorRT
Posted by GitBox <gi...@apache.org>.
handoku edited a comment on issue #19550:
URL: https://github.com/apache/incubator-mxnet/issues/19550#issuecomment-840982348
Same problem happened to resnet-50, any progress here?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] leezu commented on issue #19550: Got error in c++ inference example when enable tensorRT
Posted by GitBox <gi...@apache.org>.
leezu commented on issue #19550:
URL: https://github.com/apache/incubator-mxnet/issues/19550#issuecomment-841315957
@barry-jin does it affect the master version too?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] barry-jin edited a comment on issue #19550: Got error in c++ inference example when enable tensorRT
Posted by GitBox <gi...@apache.org>.
barry-jin edited a comment on issue #19550:
URL: https://github.com/apache/incubator-mxnet/issues/19550#issuecomment-841439592
> @barry-jin does it affect the master version too?
I'm investigating into it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] barry-jin commented on issue #19550: Got error in c++ inference example when enable tensorRT
Posted by GitBox <gi...@apache.org>.
barry-jin commented on issue #19550:
URL: https://github.com/apache/incubator-mxnet/issues/19550#issuecomment-841583103
Same issue here in master/cpp-package. The stack trace is as follows:
```
root@6da7899c2de8:/work/mxnet/cpp-package/example/inference# ./imagenet_inference --symbol_file "./model/Inception-BN-symbol.json" --params_file "./model/Inception-BN-0126.params" --batch_size 16 --num_inference_batches 500 --benchmark --enableTRT
[01:51:07] ../cpp-package/example/inference/imagenet_inference.cpp:302: Loading the model from ./model/Inception-BN-symbol.json
[01:51:07] ../src/nnvm/legacy_json_util.cc:209: Loading symbol saved by previous version v0.8.0. Attempting to upgrade...
[01:51:07] ../src/nnvm/legacy_json_util.cc:217: Symbol successfully upgraded!
[01:51:07] ../cpp-package/example/inference/imagenet_inference.cpp:317: Loading the model parameters from ./model/Inception-BN-0126.params
[01:51:07] ../src/storage/storage.cc:199: Using Pooled (Naive) StorageManager for CPU
[01:51:09] ../src/storage/storage.cc:199: Using Pooled (Naive) StorageManager for GPU
terminate called after throwing an instance of 'dmlc::Error'
what(): [01:51:09] ../cpp-package/include/mxnet-cpp/symbol.hpp:268: MXNetError: Error in operator TensorRT0: [01:51:09] ../src/operator/subgraph/tensorrt/tensorrt.cc:61: Check failed: idx_g.input_nodes().size() == in_shapes->size() + params_map.size() (55 vs. 1) :
Aborted (core dumped)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] handoku commented on issue #19550: Got error in c++ inference example when enable tensorRT
Posted by GitBox <gi...@apache.org>.
handoku commented on issue #19550:
URL: https://github.com/apache/incubator-mxnet/issues/19550#issuecomment-840982348
Save problem happened to resnet-50, any progress here?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org