You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@tvm.apache.org by GitBox <gi...@apache.org> on 2020/11/05 08:21:13 UTC

[GitHub] [incubator-tvm] joyalbin opened a new issue #6857: Not able to compile TVM with Arm Compute library

joyalbin opened a new issue #6857:
URL: https://github.com/apache/incubator-tvm/issues/6857

Hi,

Followed the below tutorial to build TVM with ARM Compute library.
https://github.com/apache/incubator-tvm/blob/e561007f0c330e3d14c2bc8a3ef40fb741db9004/docs/deploy/arm_compute_lib.rst

Steps followed:
1. Enabled USE_ARM_COMPUTE_LIB and USE_ARM_COMPUTE_LIB_GRAPH_RUNTIME in config.cmake
2. setup the prebuild library at $TVM_HOME/acl
3. Trying to build TVM with acl

This cause the issue, failed to resolve the arm compiler header file dependency in the acl source files.

`"These flags can be used in different scenarios depending on your setup. For example, if you want to compile an ACL module on an x86 machine and then run the module on a remote Arm device via RPC, you will need to use USE_ARM_COMPUTE_LIB=ON on the x86 machine and USE_ARM_COMPUTE_LIB_GRAPH_RUNTIME=ON on the remote AArch64 device."`

Someone please help to understand what exactly meant by `"USE_ARM_COMPUTE_LIB_GRAPH_RUNTIME=ON on the remote AArch64 device."`? In which case this flag as to be enabled? we don't need to build TVM after enabling this flag?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-tvm] tqchen closed issue #6857: Not able to compile TVM with Arm Compute library

Posted by GitBox <gi...@apache.org>.

tqchen closed issue #6857:
URL: https://github.com/apache/incubator-tvm/issues/6857


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-tvm] giuseros edited a comment on issue #6857: Not able to compile TVM with Arm Compute library

Posted by GitBox <gi...@apache.org>.

giuseros edited a comment on issue #6857:
URL: https://github.com/apache/incubator-tvm/issues/6857#issuecomment-723035016

Hi @joyalbin ,
So Arm Compute Library is a runtime library, and it is meant to run on Arm machines. The usual setup is the following:
- A: is the machine where you are actually compiling your network. Which is usually a x86 machine.
- B: is the machine where you run the network (e.g., through RPC). This should be an Arm machine.

About the flags:
- On machine A, you need build TVM with USE_ARM_COMPUTE_LIB to ON. In that way you tell the (Relay) compiler to annotate the Arm Compute LIbrary supported operators. On machine A USE_ARM_COMPUTE_LIB_GRAPH_RUNTIME has to be set to OFF. This is because that machine won't be able to build Arm Compute Library, being an x86 machine.

- On machine B , you need to only build the runtime with USE_ARM_COMPUTE_LIB_GRAPH_RUNTIME to ON. This is telling the runtime that whenever it sees an annotated operator, it should run it through the Arm Compute Library. Just to be clear, on machine B, you usually build only the runtime part of TVM (i.e., `make -j4 runtime`)

Some more info about all this:
- https://tvm.apache.org/2020/07/15/how-to-bring-your-own-codegen-to-tvm
- https://tvm.apache.org/docs/deploy/arm_compute_lib.html?highlight=acl
- https://discuss.tvm.apache.org/t/rfc-byoc-arm-compute-library-integration/7082

Hope this helps

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-tvm] giuseros commented on issue #6857: Not able to compile TVM with Arm Compute library

Posted by GitBox <gi...@apache.org>.

giuseros commented on issue #6857:
URL: https://github.com/apache/incubator-tvm/issues/6857#issuecomment-723035016

About the flags:
- On machine A, you need build TVM with USE_ARM_COMPUTE_LIB to ON. In that way you tell the (Relay) compiler to annotate the Arm Compute LIbrary supported operators.

Hope this helps

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-tvm] joyalbin commented on issue #6857: Not able to compile TVM with Arm Compute library

Posted by GitBox <gi...@apache.org>.

joyalbin commented on issue #6857:
URL: https://github.com/apache/incubator-tvm/issues/6857#issuecomment-722774459


   Hi All,
   While building TVM with flags USE_ARM_COMPUTE_LIB_GRAPH_RUNTIME and USE_ARM_COMPUTE_LIB set to ON, am getting below error:
   
   ![image](https://user-images.githubusercontent.com/1856674/98319564-02470200-2007-11eb-9ad5-0babc9385cbc.png)
   
   Please help me to understand how to use this feature
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-tvm] joyalbin edited a comment on issue #6857: Not able to compile TVM with Arm Compute library

Posted by GitBox <gi...@apache.org>.

joyalbin edited a comment on issue #6857:
URL: https://github.com/apache/incubator-tvm/issues/6857#issuecomment-722774459


   Hi All,
   While building TVM with flags USE_ARM_COMPUTE_LIB_GRAPH_RUNTIME and USE_ARM_COMPUTE_LIB set to ON, am getting below error:
   
   ![image](https://user-images.githubusercontent.com/1856674/98319564-02470200-2007-11eb-9ad5-0babc9385cbc.png)
   
   @jroesch @lhutton1 @giuseros help me to understand how to use this feature
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-tvm] joyalbin commented on issue #6857: Not able to compile TVM with Arm Compute library

Posted by GitBox <gi...@apache.org>.

joyalbin commented on issue #6857:
URL: https://github.com/apache/incubator-tvm/issues/6857#issuecomment-722237023


   @lhutton1 Could you please help me on this?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-tvm] tqchen commented on issue #6857: Not able to compile TVM with Arm Compute library

Posted by GitBox <gi...@apache.org>.

tqchen commented on issue #6857:
URL: https://github.com/apache/incubator-tvm/issues/6857#issuecomment-723077736


   Good discussion, seems this topic is more suitable for https://discuss.tvm.apache.org/, let us move the discussion thread


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org