[GitHub] [tvm] ShaneYS opened a new issue #10269: [Bug] the size of plan file in TVM_TENSORRT_CACHE_DIR is only 3.3K

[GitBox <gi...@apache.org>]

ShaneYS opened a new issue #10269:
URL: https://github.com/apache/tvm/issues/10269


   
   ### Expected behavior
   
   I want to save tvm(tensorrt-runtime) model as a tensorrt engine file, and load the file in tensorrt.
   
   ### Actual behavior
   
   The saved engine file (*.plan) appears to only contain structure and no parameters saved.
   
   How can I save the structure and parameters in one engine file?
   
   ```
   (base) root@e1b8a559bf1a:~/model_tvm/TVM_TENSORRT_CACHE_DIR# ll -ah
   total 16K
   drwxr-xr-x 2 root root 4.0K Feb 15 17:59 ./
   drwxrwxrwx 3 root root 4.0K Feb 15 20:25 ../
   -rw-r--r-- 1 root root   88 Feb 15 17:57 tvmgen_default_tensorrt_main_0_fp32.meta
   -rw-r--r-- 1 root root 3.3K Feb 15 17:57 tvmgen_default_tensorrt_main_0_fp32.plan
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org