You are viewing a plain text version of this content. The canonical link for it is here.
Posted to discuss-archive@tvm.apache.org by Gnupdev via Apache TVM Discuss <no...@discuss.tvm.ai> on 2021/03/05 09:04:49 UTC
[Apache TVM Discuss] [Questions] Mkldnn verbose doesn't work
Hi.
I have a question about USE_MKLDNN.
My build options :
LLVM ON
BLAS none
USE_MKL /opt/intel/mkl
USE_MKLDNN ON
Even though I set MKLDNN_VERBOSE=1, any outputs about MKLDNN are not printed while tvm relay build and module run...
tvm uses mkl(mkldnn) for dense layer.
But why this happen?
Is TVM not using mkldnn properly?
---
[Visit Topic](https://discuss.tvm.apache.org/t/mkldnn-verbose-doesnt-work/9315/1) to respond.
You are receiving this because you enabled mailing list mode.
To unsubscribe from these emails, [click here](https://discuss.tvm.apache.org/email/unsubscribe/e4624e120dd9afab8f7a6544651fbc3c52849e77e302f29e465514cb4806fe4e).
[Apache TVM Discuss] [Questions] Mkldnn verbose doesn't work
Posted by Gnupdev via Apache TVM Discuss <no...@discuss.tvm.ai>.
In pytorch, graph converts a mkldnn_graph(use to_mkldnn).
then compile the graph.
In tvm, is the same process as pytorch included in relay.build??
normal graph -> mkldnn graph.
if it's right, where can i find a graph(dense layer) applied with mkldnn.
Im already know that tvm only applies mkldnn to dense layer.
---
[Visit Topic](https://discuss.tvm.apache.org/t/mkldnn-verbose-doesnt-work/9315/7) to respond.
You are receiving this because you enabled mailing list mode.
To unsubscribe from these emails, [click here](https://discuss.tvm.apache.org/email/unsubscribe/4f54f2fde086454d993273922eb3620e4e276f3b64d820b3f73b73eaf3ace860).
[Apache TVM Discuss] [Questions] Mkldnn verbose doesn't work
Posted by Haichen Shen via Apache TVM Discuss <no...@discuss.tvm.ai>.
Sorry about the confusion. You can still use mkldnn without autoTVM tuning. The warning log only indicates that AutoTVM cannot find the profile results of mkldnn kernel.
---
[Visit Topic](https://discuss.tvm.apache.org/t/mkldnn-verbose-doesnt-work/9315/6) to respond.
You are receiving this because you enabled mailing list mode.
To unsubscribe from these emails, [click here](https://discuss.tvm.apache.org/email/unsubscribe/5725f6334035cb75f09aff00b2a304f872bd73aa8d38095021b8ce01cf4e271c).
[Apache TVM Discuss] [Questions] Mkldnn verbose doesn't work
Posted by Gnupdev via Apache TVM Discuss <no...@discuss.tvm.ai>.
Oh....
If i do not use autoTVM for tuning my graph, does mkldnn not be applied???
autoTVM : tuning my graph operation like 'for' loop (using tvm schedule primitives), it is what i know..
then mkldnn or -libs options are used like tvm schedule primitives??
---
[Visit Topic](https://discuss.tvm.apache.org/t/mkldnn-verbose-doesnt-work/9315/5) to respond.
You are receiving this because you enabled mailing list mode.
To unsubscribe from these emails, [click here](https://discuss.tvm.apache.org/email/unsubscribe/76a47dc3c632ac0a7f3a5a6bc7c7a05e81e8f0b782c6c04cb65394a7a47e0099).
[Apache TVM Discuss] [Questions] Mkldnn verbose doesn't work
Posted by Haichen Shen via Apache TVM Discuss <no...@discuss.tvm.ai>.
I'm not sure why MKLDNN_VERBOSE=1 doesn't work. The warning shows during the compilation is fine. It just means that AutoTVM doesn't find a log record corrsponding to "dense_mkldnn.x86".
---
[Visit Topic](https://discuss.tvm.apache.org/t/mkldnn-verbose-doesnt-work/9315/4) to respond.
You are receiving this because you enabled mailing list mode.
To unsubscribe from these emails, [click here](https://discuss.tvm.apache.org/email/unsubscribe/04fa1d814ee1c8abf66fcf21747c2390d67a7cee4f487eafe5fde455b4e55da0).
[Apache TVM Discuss] [Questions] Mkldnn verbose doesn't work
Posted by Gnupdev via Apache TVM Discuss <no...@discuss.tvm.ai>.
Yes. target = "llvm -mcpu=cascadelake -libs=mkldnn"
In this case MKL_VERBOSE=1 also works. In my opinion, It seems that mkl and mkldnn are not completely separated but have some overlapping parts.
By the way..I can not understand why MKLDNN_VERBOSE=1 doesn't work.
In relay build time, i saw the warnings that Cannot find config ... workload("dense_mkldnn.x86")..
---
[Visit Topic](https://discuss.tvm.apache.org/t/mkldnn-verbose-doesnt-work/9315/3) to respond.
You are receiving this because you enabled mailing list mode.
To unsubscribe from these emails, [click here](https://discuss.tvm.apache.org/email/unsubscribe/5c2f3030451fbeaef026c0224c48462afb2cb468ea5eb672767d032f2dcc20da).
[Apache TVM Discuss] [Questions] Mkldnn verbose doesn't work
Posted by Haichen Shen via Apache TVM Discuss <no...@discuss.tvm.ai>.
Did you add `-libs=mkl,mkldnn` in your target?
---
[Visit Topic](https://discuss.tvm.apache.org/t/mkldnn-verbose-doesnt-work/9315/2) to respond.
You are receiving this because you enabled mailing list mode.
To unsubscribe from these emails, [click here](https://discuss.tvm.apache.org/email/unsubscribe/9af9dfe78de59726fd9d6a12a7a2dbf3637f448b0890cc3e5492b9f7599f6ad8).