You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@tvm.apache.org by GitBox <gi...@apache.org> on 2022/05/19 12:25:35 UTC
[GitHub] [tvm] yghstill opened a new pull request, #11370: add PP-PicoDet demo
yghstill opened a new pull request, #11370:
URL: https://github.com/apache/tvm/pull/11370
Thanks for contributing to TVM! Please refer to guideline https://tvm.apache.org/docs/contribute/ for useful information and tips. After the pull request is submitted, please request code reviews from [Reviewers](https://github.com/apache/incubator-tvm/blob/master/CONTRIBUTORS.md#reviewers) by @ them in the pull request thread.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] grant-arm commented on a diff in pull request #11370: add PP-PicoDet demo
Posted by GitBox <gi...@apache.org>.
grant-arm commented on code in PR #11370:
URL: https://github.com/apache/tvm/pull/11370#discussion_r877375513
##########
apps/microtvm/picodet/run_demo.sh:
##########
@@ -0,0 +1,151 @@
+#!/bin/bash
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+export PATH=/opt/arm/FVP_Corstone_SSE-300/models/Linux64_GCC-6.4:/opt/arm/cmake/bin:$PATH
+set -e
+set -u
+set -o pipefail
+
+# Show usage
+function show_usage() {
+ cat <<EOF
+Usage: run_demo.sh
+-h, --help
+ Display this help message.
+--cmsis_path CMSIS_PATH
+ Set path to CMSIS.
+--ethosu_platform_path ETHOSU_PLATFORM_PATH
+ Set path to Arm(R) Ethos(TM)-U core platform.
+--fvp_path FVP_PATH
+ Set path to FVP.
+--cmake_path
+ Set path to cmake.
+EOF
+}
+
+# Parse arguments
+while (( $# )); do
+ case "$1" in
+ -h|--help)
+ show_usage
+ exit 0
+ ;;
+
+ --cmsis_path)
+ if [ $# -gt 1 ]
+ then
+ export CMSIS_PATH="$2"
+ shift 2
+ else
+ echo 'ERROR: --cmsis_path requires a non-empty argument' >&2
+ show_usage >&2
+ exit 1
+ fi
+ ;;
+
+ --ethosu_platform_path)
+ if [ $# -gt 1 ]
+ then
+ export ETHOSU_PLATFORM_PATH="$2"
+ shift 2
+ else
+ echo 'ERROR: --ethosu_platform_path requires a non-empty argument' >&2
+ show_usage >&2
+ exit 1
Review Comment:
This is actually necessary because the Makefile refers to `ETHOSU_PLATFORM_PATH` for determining `CORSTONE_300_PATH = ${ETHOSU_PLATFORM_PATH}/targets/corstone-300` and eventually `UART_SRCS = $(wildcard ${CORSTONE_300_PATH}/*.c)` which are necessary for the demo.
Granted the naming of `ETHOSU_PLATFORM_PATH` looks odd when the demo no longer depends on the microNPU and we should probably consider refactoring the CMSIS-NN demo and/or the `ci_cpu` docker image to change this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] grant-arm commented on a diff in pull request #11370: add PP-PicoDet demo
Posted by GitBox <gi...@apache.org>.
grant-arm commented on code in PR #11370:
URL: https://github.com/apache/tvm/pull/11370#discussion_r877376217
##########
apps/microtvm/picodet/run_demo.sh:
##########
@@ -0,0 +1,151 @@
+#!/bin/bash
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+export PATH=/opt/arm/FVP_Corstone_SSE-300/models/Linux64_GCC-6.4:/opt/arm/cmake/bin:$PATH
+set -e
+set -u
+set -o pipefail
+
+# Show usage
+function show_usage() {
+ cat <<EOF
+Usage: run_demo.sh
+-h, --help
+ Display this help message.
+--cmsis_path CMSIS_PATH
+ Set path to CMSIS.
+--ethosu_platform_path ETHOSU_PLATFORM_PATH
Review Comment:
As below, it is still required.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] areusch commented on pull request #11370: add PP-PicoDet demo
Posted by GitBox <gi...@apache.org>.
areusch commented on PR #11370:
URL: https://github.com/apache/tvm/pull/11370#issuecomment-1134990109
i think it'd be cool to convert the Ethos-U app to use Project API, but I know there are some limitations there around multiple models that might be a factor. cc @mehrdadh who was looking at this for Corstone-300 tests which also I believe use the Ethos-U demo code.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] areusch commented on pull request #11370: add PP-PicoDet demo
Posted by GitBox <gi...@apache.org>.
areusch commented on PR #11370:
URL: https://github.com/apache/tvm/pull/11370#issuecomment-1134990970
and thanks @yghstill for expanding the set of demos! I'll let @manupa-arm @grant-arm @leandron determine if there's overlap here, but broadly I don't think adding more examples will hurt us if they're different enough.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] leandron commented on a diff in pull request #11370: add PP-PicoDet demo
Posted by GitBox <gi...@apache.org>.
leandron commented on code in PR #11370:
URL: https://github.com/apache/tvm/pull/11370#discussion_r876998982
##########
apps/microtvm/picodet/README.md:
##########
@@ -0,0 +1,79 @@
+<!--- Licensed to the Apache Software Foundation (ASF) under one -->
+<!--- or more contributor license agreements. See the NOTICE file -->
+<!--- distributed with this work for additional information -->
+<!--- regarding copyright ownership. The ASF licenses this file -->
+<!--- to you under the Apache License, Version 2.0 (the -->
+<!--- "License"); you may not use this file except in compliance -->
+<!--- with the License. You may obtain a copy of the License at -->
+<!--- http://www.apache.org/licenses/LICENSE-2.0 -->
+<!--- Unless required by applicable law or agreed to in writing, -->
+<!--- software distributed under the License is distributed on an -->
+<!--- "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY -->
+<!--- KIND, either express or implied. See the License for the -->
+<!--- specific language governing permissions and limitations -->
+<!--- under the License. -->
+Running PP-PicoDet object detection model via TVM on bare metal Arm(R) Cortex(R)-M55 CPU and CMSIS-NN
+===============================================================
+This folder contains an example of how to use TVM to run a PP-PicoDet model
+on bare metal Cortex(R)-M55 CPU and CMSIS-NN.
+Prerequisites
+-------------
+If the demo is run in the ci_cpu Docker container provided with TVM, then the following
+software will already be installed.
+If the demo is not run in the ci_cpu Docker container, then you will need the following:
+- Software required to build and run the demo (These can all be installed by running
+ tvm/docker/install/ubuntu_install_ethosu_driver_stack.sh.)
+ - [Fixed Virtual Platform (FVP) based on Arm(R) Corstone(TM)-300 software](https://developer.arm.com/tools-and-software/open-source-software/arm-platforms-software/arm-ecosystem-fvps)
+ - [cmake 3.19.5](https://github.com/Kitware/CMake/releases/)
+ - [GCC toolchain from Arm(R)](https://developer.arm.com/-/media/Files/downloads/gnu-rm/10-2020q4/gcc-arm-none-eabi-10-2020-q4-major-x86_64-linux.tar.bz2)
+ - [Arm(R) Ethos(TM)-U NPU driver stack](https://review.mlplatform.org)
+ - [CMSIS](https://github.com/ARM-software/CMSIS_5)
+- The python libraries listed in the requirements.txt of this directory
+ - These can be installed by running the following from the current directory:
+ ```bash
+ pip install -r ./requirements.txt
+ ```
+You will also need TVM which can either be:
+ - Built from source (see [Install from Source](https://tvm.apache.org/docs/install/from_source.html))
+ - When building from source, the following need to be set in config.cmake:
+ - set(USE_CMSISNN ON)
+ - set(USE_MICRO ON)
+ - set(USE_LLVM ON)
+ - Installed from TLCPack(see [TLCPack](https://tlcpack.ai/))
+You will need to update your PATH environment variable to include the path to cmake 3.19.5 and the FVP.
+For example if you've installed these in ```/opt/arm``` , then you would do the following:
+```bash
+export PATH=/opt/arm/FVP_Corstone_SSE-300/models/Linux64_GCC-6.4:/opt/arm/cmake/bin:$PATH
+```
+Running the demo application
+----------------------------
+Type the following command to run the bare metal text recognition application ([src/demo_bare_metal.c](./src/demo_bare_metal.c)):
+```bash
+./run_demo.sh
+```
+If the Ethos(TM)-U platform and/or CMSIS have not been installed in /opt/arm/ethosu then
+the locations for these can be specified as arguments to run_demo.sh, for example:
+```bash
+./run_demo.sh --cmsis_path /home/tvm-user/cmsis \
+--ethosu_platform_path /home/tvm-user/ethosu/core_platform
+```
+This will:
+- Download a PP-PicoDet text recognition model
+- Use tvmc to compile the text recognition model for Cortex(R)-M55 CPU and CMSIS-NN
+- Create a C header file inputs.c containing the image data as a C array
+- Create a C header file outputs.c containing a C array where the output of inference will be stored
+- Build the demo application
+- Run the demo application on a Fixed Virtual Platform (FVP) based on Arm(R) Corstone(TM)-300 software
+- The application will report the text on the image and the corresponding score.
+Using your own image
+--------------------
+The create_image.py script takes a single argument on the command line which is the path of the
+image to be converted into an array of bytes for consumption by the model.
+The demo can be modified to use an image of your choice by changing the following line in run_demo.sh
+```bash
+python3 ./convert_image.py images/000000014439_640x640.jpg
Review Comment:
Perhaps this image `000000014439_640x640.jpg` could be renamed to something more user friendly?
##########
apps/microtvm/picodet/README.md:
##########
@@ -0,0 +1,79 @@
+<!--- Licensed to the Apache Software Foundation (ASF) under one -->
+<!--- or more contributor license agreements. See the NOTICE file -->
+<!--- distributed with this work for additional information -->
+<!--- regarding copyright ownership. The ASF licenses this file -->
+<!--- to you under the Apache License, Version 2.0 (the -->
+<!--- "License"); you may not use this file except in compliance -->
+<!--- with the License. You may obtain a copy of the License at -->
+<!--- http://www.apache.org/licenses/LICENSE-2.0 -->
+<!--- Unless required by applicable law or agreed to in writing, -->
+<!--- software distributed under the License is distributed on an -->
+<!--- "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY -->
+<!--- KIND, either express or implied. See the License for the -->
+<!--- specific language governing permissions and limitations -->
+<!--- under the License. -->
+Running PP-PicoDet object detection model via TVM on bare metal Arm(R) Cortex(R)-M55 CPU and CMSIS-NN
+===============================================================
+This folder contains an example of how to use TVM to run a PP-PicoDet model
+on bare metal Cortex(R)-M55 CPU and CMSIS-NN.
+Prerequisites
+-------------
+If the demo is run in the ci_cpu Docker container provided with TVM, then the following
+software will already be installed.
+If the demo is not run in the ci_cpu Docker container, then you will need the following:
+- Software required to build and run the demo (These can all be installed by running
+ tvm/docker/install/ubuntu_install_ethosu_driver_stack.sh.)
+ - [Fixed Virtual Platform (FVP) based on Arm(R) Corstone(TM)-300 software](https://developer.arm.com/tools-and-software/open-source-software/arm-platforms-software/arm-ecosystem-fvps)
+ - [cmake 3.19.5](https://github.com/Kitware/CMake/releases/)
+ - [GCC toolchain from Arm(R)](https://developer.arm.com/-/media/Files/downloads/gnu-rm/10-2020q4/gcc-arm-none-eabi-10-2020-q4-major-x86_64-linux.tar.bz2)
+ - [Arm(R) Ethos(TM)-U NPU driver stack](https://review.mlplatform.org)
Review Comment:
Does this demo requires this step/dependency?
##########
apps/microtvm/picodet/run_demo.sh:
##########
@@ -0,0 +1,151 @@
+#!/bin/bash
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+export PATH=/opt/arm/FVP_Corstone_SSE-300/models/Linux64_GCC-6.4:/opt/arm/cmake/bin:$PATH
+set -e
+set -u
+set -o pipefail
+
+# Show usage
+function show_usage() {
+ cat <<EOF
+Usage: run_demo.sh
+-h, --help
+ Display this help message.
+--cmsis_path CMSIS_PATH
+ Set path to CMSIS.
+--ethosu_platform_path ETHOSU_PLATFORM_PATH
Review Comment:
Is this dependency required here?
##########
apps/microtvm/picodet/README.md:
##########
@@ -0,0 +1,79 @@
+<!--- Licensed to the Apache Software Foundation (ASF) under one -->
+<!--- or more contributor license agreements. See the NOTICE file -->
+<!--- distributed with this work for additional information -->
+<!--- regarding copyright ownership. The ASF licenses this file -->
+<!--- to you under the Apache License, Version 2.0 (the -->
+<!--- "License"); you may not use this file except in compliance -->
+<!--- with the License. You may obtain a copy of the License at -->
+<!--- http://www.apache.org/licenses/LICENSE-2.0 -->
+<!--- Unless required by applicable law or agreed to in writing, -->
+<!--- software distributed under the License is distributed on an -->
+<!--- "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY -->
+<!--- KIND, either express or implied. See the License for the -->
+<!--- specific language governing permissions and limitations -->
+<!--- under the License. -->
+Running PP-PicoDet object detection model via TVM on bare metal Arm(R) Cortex(R)-M55 CPU and CMSIS-NN
+===============================================================
+This folder contains an example of how to use TVM to run a PP-PicoDet model
Review Comment:
Can you improve this document with more context about PP-PicoDet?
##########
apps/microtvm/picodet/run_demo.sh:
##########
@@ -0,0 +1,151 @@
+#!/bin/bash
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+export PATH=/opt/arm/FVP_Corstone_SSE-300/models/Linux64_GCC-6.4:/opt/arm/cmake/bin:$PATH
+set -e
+set -u
+set -o pipefail
+
+# Show usage
+function show_usage() {
+ cat <<EOF
+Usage: run_demo.sh
+-h, --help
+ Display this help message.
+--cmsis_path CMSIS_PATH
+ Set path to CMSIS.
+--ethosu_platform_path ETHOSU_PLATFORM_PATH
+ Set path to Arm(R) Ethos(TM)-U core platform.
+--fvp_path FVP_PATH
+ Set path to FVP.
+--cmake_path
+ Set path to cmake.
+EOF
+}
+
+# Parse arguments
+while (( $# )); do
+ case "$1" in
+ -h|--help)
+ show_usage
+ exit 0
+ ;;
+
+ --cmsis_path)
+ if [ $# -gt 1 ]
+ then
+ export CMSIS_PATH="$2"
+ shift 2
+ else
+ echo 'ERROR: --cmsis_path requires a non-empty argument' >&2
+ show_usage >&2
+ exit 1
+ fi
+ ;;
+
+ --ethosu_platform_path)
+ if [ $# -gt 1 ]
+ then
+ export ETHOSU_PLATFORM_PATH="$2"
+ shift 2
+ else
+ echo 'ERROR: --ethosu_platform_path requires a non-empty argument' >&2
+ show_usage >&2
+ exit 1
Review Comment:
Is this necessary in this script?
##########
apps/microtvm/picodet/README.md:
##########
@@ -0,0 +1,79 @@
+<!--- Licensed to the Apache Software Foundation (ASF) under one -->
+<!--- or more contributor license agreements. See the NOTICE file -->
+<!--- distributed with this work for additional information -->
+<!--- regarding copyright ownership. The ASF licenses this file -->
+<!--- to you under the Apache License, Version 2.0 (the -->
+<!--- "License"); you may not use this file except in compliance -->
+<!--- with the License. You may obtain a copy of the License at -->
+<!--- http://www.apache.org/licenses/LICENSE-2.0 -->
+<!--- Unless required by applicable law or agreed to in writing, -->
+<!--- software distributed under the License is distributed on an -->
+<!--- "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY -->
+<!--- KIND, either express or implied. See the License for the -->
+<!--- specific language governing permissions and limitations -->
+<!--- under the License. -->
+Running PP-PicoDet object detection model via TVM on bare metal Arm(R) Cortex(R)-M55 CPU and CMSIS-NN
+===============================================================
+This folder contains an example of how to use TVM to run a PP-PicoDet model
+on bare metal Cortex(R)-M55 CPU and CMSIS-NN.
+Prerequisites
+-------------
+If the demo is run in the ci_cpu Docker container provided with TVM, then the following
+software will already be installed.
+If the demo is not run in the ci_cpu Docker container, then you will need the following:
+- Software required to build and run the demo (These can all be installed by running
+ tvm/docker/install/ubuntu_install_ethosu_driver_stack.sh.)
+ - [Fixed Virtual Platform (FVP) based on Arm(R) Corstone(TM)-300 software](https://developer.arm.com/tools-and-software/open-source-software/arm-platforms-software/arm-ecosystem-fvps)
+ - [cmake 3.19.5](https://github.com/Kitware/CMake/releases/)
+ - [GCC toolchain from Arm(R)](https://developer.arm.com/-/media/Files/downloads/gnu-rm/10-2020q4/gcc-arm-none-eabi-10-2020-q4-major-x86_64-linux.tar.bz2)
+ - [Arm(R) Ethos(TM)-U NPU driver stack](https://review.mlplatform.org)
+ - [CMSIS](https://github.com/ARM-software/CMSIS_5)
+- The python libraries listed in the requirements.txt of this directory
+ - These can be installed by running the following from the current directory:
+ ```bash
+ pip install -r ./requirements.txt
+ ```
+You will also need TVM which can either be:
+ - Built from source (see [Install from Source](https://tvm.apache.org/docs/install/from_source.html))
+ - When building from source, the following need to be set in config.cmake:
+ - set(USE_CMSISNN ON)
+ - set(USE_MICRO ON)
+ - set(USE_LLVM ON)
+ - Installed from TLCPack(see [TLCPack](https://tlcpack.ai/))
+You will need to update your PATH environment variable to include the path to cmake 3.19.5 and the FVP.
+For example if you've installed these in ```/opt/arm``` , then you would do the following:
+```bash
+export PATH=/opt/arm/FVP_Corstone_SSE-300/models/Linux64_GCC-6.4:/opt/arm/cmake/bin:$PATH
+```
+Running the demo application
+----------------------------
+Type the following command to run the bare metal text recognition application ([src/demo_bare_metal.c](./src/demo_bare_metal.c)):
+```bash
+./run_demo.sh
+```
+If the Ethos(TM)-U platform and/or CMSIS have not been installed in /opt/arm/ethosu then
+the locations for these can be specified as arguments to run_demo.sh, for example:
+```bash
+./run_demo.sh --cmsis_path /home/tvm-user/cmsis \
+--ethosu_platform_path /home/tvm-user/ethosu/core_platform
+```
+This will:
+- Download a PP-PicoDet text recognition model
+- Use tvmc to compile the text recognition model for Cortex(R)-M55 CPU and CMSIS-NN
+- Create a C header file inputs.c containing the image data as a C array
+- Create a C header file outputs.c containing a C array where the output of inference will be stored
+- Build the demo application
+- Run the demo application on a Fixed Virtual Platform (FVP) based on Arm(R) Corstone(TM)-300 software
+- The application will report the text on the image and the corresponding score.
+Using your own image
+--------------------
+The create_image.py script takes a single argument on the command line which is the path of the
+image to be converted into an array of bytes for consumption by the model.
+The demo can be modified to use an image of your choice by changing the following line in run_demo.sh
+```bash
+python3 ./convert_image.py images/000000014439_640x640.jpg
+```
+
+Model description
Review Comment:
Perhaps it worth a mention to the paper which described this model in detail?
##########
apps/microtvm/picodet/README.md:
##########
@@ -0,0 +1,79 @@
+<!--- Licensed to the Apache Software Foundation (ASF) under one -->
+<!--- or more contributor license agreements. See the NOTICE file -->
+<!--- distributed with this work for additional information -->
+<!--- regarding copyright ownership. The ASF licenses this file -->
+<!--- to you under the Apache License, Version 2.0 (the -->
+<!--- "License"); you may not use this file except in compliance -->
+<!--- with the License. You may obtain a copy of the License at -->
+<!--- http://www.apache.org/licenses/LICENSE-2.0 -->
+<!--- Unless required by applicable law or agreed to in writing, -->
+<!--- software distributed under the License is distributed on an -->
+<!--- "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY -->
+<!--- KIND, either express or implied. See the License for the -->
+<!--- specific language governing permissions and limitations -->
+<!--- under the License. -->
+Running PP-PicoDet object detection model via TVM on bare metal Arm(R) Cortex(R)-M55 CPU and CMSIS-NN
+===============================================================
+This folder contains an example of how to use TVM to run a PP-PicoDet model
+on bare metal Cortex(R)-M55 CPU and CMSIS-NN.
+Prerequisites
+-------------
+If the demo is run in the ci_cpu Docker container provided with TVM, then the following
+software will already be installed.
+If the demo is not run in the ci_cpu Docker container, then you will need the following:
+- Software required to build and run the demo (These can all be installed by running
+ tvm/docker/install/ubuntu_install_ethosu_driver_stack.sh.)
+ - [Fixed Virtual Platform (FVP) based on Arm(R) Corstone(TM)-300 software](https://developer.arm.com/tools-and-software/open-source-software/arm-platforms-software/arm-ecosystem-fvps)
+ - [cmake 3.19.5](https://github.com/Kitware/CMake/releases/)
+ - [GCC toolchain from Arm(R)](https://developer.arm.com/-/media/Files/downloads/gnu-rm/10-2020q4/gcc-arm-none-eabi-10-2020-q4-major-x86_64-linux.tar.bz2)
+ - [Arm(R) Ethos(TM)-U NPU driver stack](https://review.mlplatform.org)
+ - [CMSIS](https://github.com/ARM-software/CMSIS_5)
+- The python libraries listed in the requirements.txt of this directory
+ - These can be installed by running the following from the current directory:
+ ```bash
+ pip install -r ./requirements.txt
+ ```
+You will also need TVM which can either be:
+ - Built from source (see [Install from Source](https://tvm.apache.org/docs/install/from_source.html))
+ - When building from source, the following need to be set in config.cmake:
+ - set(USE_CMSISNN ON)
+ - set(USE_MICRO ON)
+ - set(USE_LLVM ON)
+ - Installed from TLCPack(see [TLCPack](https://tlcpack.ai/))
+You will need to update your PATH environment variable to include the path to cmake 3.19.5 and the FVP.
+For example if you've installed these in ```/opt/arm``` , then you would do the following:
+```bash
+export PATH=/opt/arm/FVP_Corstone_SSE-300/models/Linux64_GCC-6.4:/opt/arm/cmake/bin:$PATH
+```
+Running the demo application
+----------------------------
+Type the following command to run the bare metal text recognition application ([src/demo_bare_metal.c](./src/demo_bare_metal.c)):
+```bash
+./run_demo.sh
+```
+If the Ethos(TM)-U platform and/or CMSIS have not been installed in /opt/arm/ethosu then
+the locations for these can be specified as arguments to run_demo.sh, for example:
+```bash
+./run_demo.sh --cmsis_path /home/tvm-user/cmsis \
+--ethosu_platform_path /home/tvm-user/ethosu/core_platform
+```
+This will:
+- Download a PP-PicoDet text recognition model
Review Comment:
I'm not finding in the script where this is done, can you point me to where the model is being downloaded?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] grant-arm commented on pull request #11370: add PP-PicoDet demo
Posted by GitBox <gi...@apache.org>.
grant-arm commented on PR #11370:
URL: https://github.com/apache/tvm/pull/11370#issuecomment-1132009977
Hi @yghstill, thanks for contributing this. It would be great to see a PP demo targeting CMSIS-NN land.
I tried the demo locally and @leandron has noted, the script doesn't appear to download the model, so the demo fails.
I'm also wondering whether this should be a demo in its own right or whether we should be parameterizing the existing CMSIS-NN demo to allow different models to be consumed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] yghstill closed pull request #11370: add PP-PicoDet demo
Posted by GitBox <gi...@apache.org>.
yghstill closed pull request #11370: add PP-PicoDet demo
URL: https://github.com/apache/tvm/pull/11370
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] leandron commented on pull request #11370: add PP-PicoDet demo
Posted by GitBox <gi...@apache.org>.
leandron commented on PR #11370:
URL: https://github.com/apache/tvm/pull/11370#issuecomment-1131626530
Hi @yghstill, can you please add a description of the work done in this PR, as well as some more context on the platform being supported?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] grant-arm commented on a diff in pull request #11370: add PP-PicoDet demo
Posted by GitBox <gi...@apache.org>.
grant-arm commented on code in PR #11370:
URL: https://github.com/apache/tvm/pull/11370#discussion_r877378447
##########
apps/microtvm/picodet/README.md:
##########
@@ -0,0 +1,79 @@
+<!--- Licensed to the Apache Software Foundation (ASF) under one -->
+<!--- or more contributor license agreements. See the NOTICE file -->
+<!--- distributed with this work for additional information -->
+<!--- regarding copyright ownership. The ASF licenses this file -->
+<!--- to you under the Apache License, Version 2.0 (the -->
+<!--- "License"); you may not use this file except in compliance -->
+<!--- with the License. You may obtain a copy of the License at -->
+<!--- http://www.apache.org/licenses/LICENSE-2.0 -->
+<!--- Unless required by applicable law or agreed to in writing, -->
+<!--- software distributed under the License is distributed on an -->
+<!--- "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY -->
+<!--- KIND, either express or implied. See the License for the -->
+<!--- specific language governing permissions and limitations -->
+<!--- under the License. -->
+Running PP-PicoDet object detection model via TVM on bare metal Arm(R) Cortex(R)-M55 CPU and CMSIS-NN
+===============================================================
+This folder contains an example of how to use TVM to run a PP-PicoDet model
+on bare metal Cortex(R)-M55 CPU and CMSIS-NN.
+Prerequisites
+-------------
+If the demo is run in the ci_cpu Docker container provided with TVM, then the following
+software will already be installed.
+If the demo is not run in the ci_cpu Docker container, then you will need the following:
+- Software required to build and run the demo (These can all be installed by running
+ tvm/docker/install/ubuntu_install_ethosu_driver_stack.sh.)
+ - [Fixed Virtual Platform (FVP) based on Arm(R) Corstone(TM)-300 software](https://developer.arm.com/tools-and-software/open-source-software/arm-platforms-software/arm-ecosystem-fvps)
+ - [cmake 3.19.5](https://github.com/Kitware/CMake/releases/)
+ - [GCC toolchain from Arm(R)](https://developer.arm.com/-/media/Files/downloads/gnu-rm/10-2020q4/gcc-arm-none-eabi-10-2020-q4-major-x86_64-linux.tar.bz2)
+ - [Arm(R) Ethos(TM)-U NPU driver stack](https://review.mlplatform.org)
Review Comment:
The existing CMSIS-NN demo and by extension this one, still depend on the code that targets the UART on the FVP, whic is included in the microNPU driver stack. We should probably consider refactoring these demos to change this because it does look a bit odd since the microNPU isn't being targetted here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] grant-arm commented on a diff in pull request #11370: add PP-PicoDet demo
Posted by GitBox <gi...@apache.org>.
grant-arm commented on code in PR #11370:
URL: https://github.com/apache/tvm/pull/11370#discussion_r877378447
##########
apps/microtvm/picodet/README.md:
##########
@@ -0,0 +1,79 @@
+<!--- Licensed to the Apache Software Foundation (ASF) under one -->
+<!--- or more contributor license agreements. See the NOTICE file -->
+<!--- distributed with this work for additional information -->
+<!--- regarding copyright ownership. The ASF licenses this file -->
+<!--- to you under the Apache License, Version 2.0 (the -->
+<!--- "License"); you may not use this file except in compliance -->
+<!--- with the License. You may obtain a copy of the License at -->
+<!--- http://www.apache.org/licenses/LICENSE-2.0 -->
+<!--- Unless required by applicable law or agreed to in writing, -->
+<!--- software distributed under the License is distributed on an -->
+<!--- "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY -->
+<!--- KIND, either express or implied. See the License for the -->
+<!--- specific language governing permissions and limitations -->
+<!--- under the License. -->
+Running PP-PicoDet object detection model via TVM on bare metal Arm(R) Cortex(R)-M55 CPU and CMSIS-NN
+===============================================================
+This folder contains an example of how to use TVM to run a PP-PicoDet model
+on bare metal Cortex(R)-M55 CPU and CMSIS-NN.
+Prerequisites
+-------------
+If the demo is run in the ci_cpu Docker container provided with TVM, then the following
+software will already be installed.
+If the demo is not run in the ci_cpu Docker container, then you will need the following:
+- Software required to build and run the demo (These can all be installed by running
+ tvm/docker/install/ubuntu_install_ethosu_driver_stack.sh.)
+ - [Fixed Virtual Platform (FVP) based on Arm(R) Corstone(TM)-300 software](https://developer.arm.com/tools-and-software/open-source-software/arm-platforms-software/arm-ecosystem-fvps)
+ - [cmake 3.19.5](https://github.com/Kitware/CMake/releases/)
+ - [GCC toolchain from Arm(R)](https://developer.arm.com/-/media/Files/downloads/gnu-rm/10-2020q4/gcc-arm-none-eabi-10-2020-q4-major-x86_64-linux.tar.bz2)
+ - [Arm(R) Ethos(TM)-U NPU driver stack](https://review.mlplatform.org)
Review Comment:
The existing CMSIS-NN demo and by extension this one, still depend on the code that targets the UART on the FVP, which is included in the microNPU driver stack. We should probably consider refactoring these demos to change this because it does look a bit odd since the microNPU isn't being targeted here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org