You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@tvm.apache.org by sy...@apache.org on 2024/01/17 06:15:25 UTC
(tvm) branch test_all_cases_on_unity updated (242587613a -> 0c5ab8c13a)
This is an automated email from the ASF dual-hosted git repository.
syfeng pushed a change to branch test_all_cases_on_unity
in repository https://gitbox.apache.org/repos/asf/tvm.git
discard 242587613a fix cutlass gen
discard fc5e0346f9 try disable stream
discard 7e988c6b01 upd
discard 7558a82f14 try enable USE_GRAPH_EXECUTOR_CUDA_GRAPH
discard a4d0a81137 restore MSC
discard 436d358302 disable regex
discard d742c64023 Merge commit 'b5b980e33a6af22793279d5bb85cc45c2b525799' into test_all_cases_on_unity
discard c57407282c try disable MSC
discard f52a5545e2 upd gpu s3 upload
discard 08ce63d75b [Unity][Bugfix] Fix `tests/python/topi/test_topi_transform.py::test_relax_dynamic_strided_slice` (#16205)
discard 8ed29df6c2 upd gpu build machine
discard 7ba76b4a82 upd irmodule
discard b440f1b322 upd
discard c1f3d83bca update
discard 88241d7be3 upd
discard 2c59ceb90e [Unity] Fix tests on the main branch
discard d47107f86a fix `test_py_converter`
discard f905b83011 Merge commit 'c1523ab50a035909e7dcf4283be60c08846c0d39' into test_all_cases_on_unity
discard c1523ab50a [Unity] Fix Rust IRModule Constructor
discard bb57ff97a6 upd ci
discard 046784fbb3 Merge remote-tracking branch 'apache-tvm/main' into test_all_cases_on_unity
discard ae91240483 upd ci
add 8241385f59 [Unity] De-duplicate calls to TensorStructInfo constructor (#16209)
add 2772fb072a [Unity] Fix upstream tests that fail on unity branch (#16196)
add c6d4926529 [Dlight] Fix NormalizePrimFunc with scalar block (#16156)
add af14fbbbe1 [Relax] Fix to enable emit_te of topi scan/sort kernels (#16226)
add 943508a295 [Unity] Fix typo in dlight fallback rule (#16230)
add cbcb67c047 [Unity][Frontend] Add the `sum` op to frontend ops (#16225)
add fe89ccc360 [Unity][Transform] Pass for automatically extracting DataflowBlocks (#16204)
add f7b0193f9d [Unity] Fix IndexDataTypeNormalizer so that it correctly handles corner case (#16235)
add e100a13737 [Unity] Fix legalizing strided slice (#16232)
add 674167805c Revert "[Unity] Fix IndexDataTypeNormalizer so that it correctly handles corner case" (#16241)
add 6118b770b1 [Unity] Improved error checking for DataflowBlock in nested SeqExpr (#16195)
add e1964eceb5 [Unity] Add runtime debugging method to RelaxVM (#16238)
add cd9445d63b [Unity][lm_support] window kvcache sink (#16240)
add a2e19d21eb [Unity] Fix IndexDataTypeNormalizer so that it correctly handles corner case (#16245)
add 8edfee8574 [Unity][MSC][M2.4] Add quantizer for quantize model (#16228)
add 5b1fa29838 [Unity][VM] Allow `pipeline=None` in `relax.build` (#16246)
add f794db4373 [Unity] Avoid to use `std::regex` (#16249)
add 2d0d4e46a9 [Unity] Enable spot nodes in CI (#16253)
add a0e58987b0 [Unity][nn.Module] Refactor `ExternModule` (#16247)
add 76e239e2e1 [Unity] Fix Cutlass Codegen for Dense (#16252)
add 95f1b5c0e8 [Unity] Hot Fix Unity CI (#16256)
add e98fdea654 [Unity] Bump fpA_intB_gemm (#16244)
add 4e66690a4d [Fix] add TVM_DLL to disco functions (#16258)
add 45eeb8c838 [Unity] Fix ccache env for `nn.SourceModule` (#16257)
add f328e9bde3 [Unity] Add missing library import (#16263)
add 1c35c39264 [Unity] Add Relax multi-device e2e cases (#15823)
add 3de5e865df [Unity][nn.Module] Support Runtime-Calling Any PackedFunc via `op.extern` (#16274)
add 5c8caa6e35 [Unity] Unified KV cache interface and PagedKVCache refactor (#16273)
add 2bf3a0a428 [Unity][MSC][M3.1] Add distiller for distill model (#16264)
add 889d2f6cef [Unity][Frontend] NNModule `tensor_ir_op` support (#16278)
add 8946efa62e Update FlashInfer (#16281)
add 58daeb4905 Update FlashInfer (#16292)
add 303afdbccc [Unity][MSC][M3.2] Add gym for pruning and quantization, enable auto prune/quantize (#16280)
add 2f7e0d578f [Unity] Ensure memory planning cross-function independence (#16318)
add beb832616d [Unity] Update cutlass FpA IntB GeMM submodule (#16320)
add 8867de843d [Unity][MSC][Bugfix] Use random workspace for test (#16322)
add 9030522960 [Unity][Frontend] Introducing Object (#16316)
add b1df4b0856 [Unity][Web][Fix] Fix fetchNDArray for f32-to-bf16 (#16294)
add faa8a0ad46 [Unity][nn.Module] Introduce operator `empty` (#16327)
add ac568eb30a [Unity] Fix PagedKVCache per FlashInfer update (#16317)
add 09c44e6a93 [Unity] Upgrade flashinfer 3rdparty submodule (#16323)
add 163c7ac436 [Unity] Cutlass kernel compatibility with cmake 3.18+ (#16302)
add b3f0e55f24 Change metal dtype of ceil_log2 to fp32 (#16332)
add 4a7e4fec37 [Unity] Fix nn.op.tensor_ir_op signature (#16333)
add 1af82ad666 [Unity] Validate struct info in relax::Call constructor (#16311)
add ec542da8cf [Unity][Transform] Extract partial-tuple-usage from FuseTIR (#16120)
add 6f2fe457c2 [Unity][UnitTest] Increase atol to resolve flaky CI failure (#16340)
add 0cf5f47a1e [Unity] Dispatch cumsum and sort (#16254)
add 7dfc863df8 [Unity] Alter op impl handling empty transform for output (#16331)
add d88cc4267d [Unity][Transform] Implement UpdateParamStructInfo (#16305)
add d509661f89 [Unity][Analysis] Handle PrimStructInfo in EraseToWellDefined (#16304)
add 49fc613a3c [Unity][WEBGPU] Enable wasm exception propagation (#16330)
add c3aa71a53e [Unity][Analysis] Add utility for collecting compile-time bindings (#16312)
add 8d72091b27 [DLight] Skip rule if target is not suitable (#16321)
add 31659b617f [Unity][Dlight] Support dlight gemv rule on nested inner block (#16251)
add fe5f6163e6 [Unity][MSC][Legalize] legalize codes and mute logging (#16325)
add f215a417bf [Unity][NN] Use Linear name for nn.op.permute_dims (#16303)
add ded4be4b39 enhance shared memory merge.
add 6b6419c55f merge from unity upstream
add 047211f1da revert the change for dyanmic test
add 76ceff2c5e fix typo
add e3216a6972 lint fix
add 3fad0109bf [Unity][Contrib] Add vLLM paged attention kernel (#16350)
add 2eb17fa87f [Device][Metal] Fix metal warp size (#16192)
add 37329bf8c3 [BugFix] Fix the error of reloading the model library on the ROCm platform: "MIOpen Error: No invoker was registered for convolution forward.” (#16190)
add 71081a8616 Fix IRModule initialization with attrs (#16202)
add fe27973da0 Bump cryptography from 37.0.2 to 41.0.6 in /docker/python (#16174)
add bf071dea54 [Relay][Frontend] Preserve Pytorch Span Names (#16171)
add 65121c878a [Relay][Frontend] Add support for aten::concat (#16199)
add a9fcac1a47 [Python] Fix setup.py for inplace build (#16214)
add a59db03777 remove deprecated np.int in slice converter (pytorch) (#16221)
add b0e146f767 [TIR] ConvertSSA process entry func first (#16236)
add c8bfdb21ab [BugFix][TIR] Fix dynamic smem merge leaf alloc (#16216)
add 37c38acc46 [Target] Add Jetson AGX Orin tags (#16231)
add b3eec91ee6 [TFLite] Add support for quantized mirror pad (#16243)
add 870246a369 [LoopPartition] Fix a bug of LoopPartition in single point scenarioes (#16104)
add 799e81036d [ARITH] Simplify nested if_then_else when constant is appearing in then_expr (#16227)
add 3df798d422 [Relay][TOPI] Add support for group_conv1d_transpose_ncw for generic (#16248)
add 943861c85c [TIR][Schedule] TileWithTensorIntrin skip incorrect ComputeInline for input-padding (#16239)
add 759ee1236a [Support] Add Interrupt Handling in Pipe (#16255)
add 3a57a40c1b [RUNTIME][CLML] Fix for CLML ops and enable more test case (#15896)
add f36a093c20 Update conv2d.py (#16262)
add d310d7db59 [TOPI] Add support for group_conv3d_transpose_ncdhw for generic (#16259)
add a906504389 [TVMScript] Disable concise scoping when the scope stmt is explicitly annotated (#16271)
add a050696ca5 replace deprecated np.int with int to avoid crash (#16279)
add 1c4538947b [BugFix] Fixed Inappropriate Logical Expression (#16272)
add 506eff23b0 [Relay][Frontend][QNN] fix access `param_debug_name_map` to node output name in fx-quantized graph node replacement (#16217)
add 2da3798dd1 [Relay][Frontend][Torch] add aten:broadcast_to (#16319)
add 8b2cff8ab9 [Doc] Fix minor error in doc (Add an operator to Relay) (#16282)
add c157ca1a52 [BugFix] Update pillow usage (#16269)
add 7445b8723c [release] Update version to 0.15.0 on main branch
add e69363ab1e [release] Update version to 0.16.dev0 on main branch
add 97f6e6507f [CI] Upgrade cmake version to 3.24.0 (#16336)
add 8eec0bff6b [TIR][Transform] Implement InlinePrivateFunctions (#16184)
add eb15d04c3b [TIR] In SplitHostDevice, check for variables in thread extents (#16250)
add 42b4f213a7 [Hexagon][UnitTest] Disable flaky quantization test (#16337)
add 380147d059 [Doc] Fix minor error in "Expressions in Relay" (#16346)
add 56bdcee750 [CMake] Use ccache as CMAKE_CUDA_COMPILER_LAUNCHER (#16341)
add 5308739741 [TIR] Allow sync threads inside condition (#16345)
add ae7d9dbe06 [Codegen] Fix if_then_else codegen (#16242)
add e3d031bc7c [CMake][MSVC] Disable permissive mode for MSVC builds (#16343)
add 51bdaec6e3 [Docker] Upgrade pip in i386 container (#16348)
add b47280b1fa Merge branch 'main' into 'unity'
add 155dd73ac6 Fix after merging 'main' into 'unity'
add 0b13b5c844 [Unity] Enhance Torch-consistency in rehsape (#16360)
add 8e54a9e91d [Unity][DLight] Introduce Specific Rule for RMSNorm (#16338)
add 4c77f0fc24 [TIR] Extend DP4A tensor intrin (#16293)
add ef2a9139c1 [Unity] Improved error message for matmul shape mismatch (#16308)
add b22aa0f7c7 [Unity] Improved error message in ExprMutator::ReEmitBinding (#16307)
add fab6db20e7 [Unity][Transform] Use parameter name in BundleModelParams (#16309)
add 9caa179ce6 [CI] Update docker images tag to 20240105-165030-51bdaec6 (#16344)
add a1a1a7ca03 [AUTOTVM][FIX] Typo fixes and add a warning in the Droplet Search (#16289)
add 1e95b63fcc Merge branch 'main' of github.com:apache/tvm into unity
add 2d53e6ac63 [Unity][Transform] Handle replacement at both var binding and usage (#16367)
add a796023342 [Unity][Fix] Memory planning check value type of 'tir_var_upper_bound' (#16362)
add 4a37cfefa0 [Unity][Analysis] Show objects instead of names in WellFormedChecker (#16310)
add 4e05eb4e1c [CI] Upgrade Unity ci images (#16369)
add 298ad2c3f6 [Unity][Transform] Update LambdaLift to use name of lifted lambda (#16306)
add e1d71b3720 [Unity] Add dlight.gpu.Fallback in DispatchSortScan, add argsort, topk, and cumprod (#16351)
add 9d483d462e [LLVM] Update Host.h path (#16373)
add 3166366af6 [CI] Upgrade sccache version to 0.7.* (#16366)
add 524ec5f1b0 [Runtime] Use cudaGetDeviceCount to check if device exists (#16377)
add 45532d791c Merge branch 'main' of github.com:apache/tvm into unity
add 474c06b8b3 [Unity] Set CMAKE_CUDA_ARCHITECTURES default to native (#16335)
add 0b2358c2e4 [Relay] make "ToScalar" support directly obtaining "int64_t" (#16324)
add e53a8bcfb9 [TOPI][Target] Add fp16 SIMD support for conv2d on `arm_cpu` targets (#16383)
add 8e67e2a3a1 [TVMC] Add tvmc flag to print ir before and print ir after named pass (#16261)
add e2e33ddd54 [Bugfix] Disable SingleEnvThreadVerifier (#16361)
add 5d4c01e0fc [Thrust] Use no sync exec policy and caching allocator (#16386)
add c40d96b59e Merge remote-tracking branch 'upstream/main' into unity
add b8230f6e47 [Unity] Update dispatch test cases following the merge from main (#16388)
add 81a6c51ba4 [Unity] Fix creation of disco ProcessSession (#16375)
add d1b890a4e3 [Unity][Contrib] Fix a bug due to typo in vllm `reconstruct_from_cache` kernel and add test (#16376)
add b69d720593 [Unity][MSC] Avoid depending on trivial bindings in Relax intermediate (#16349)
add 4c7c010513 [Unity][Transform] Implement relax.transform.AdjustMatmulOrder (#16314)
add 7798e93529 [Unity] Support TIR kernel for PagedKVCache (#16374)
add 138cb651e0 [Unity][BlockBuilder] Restore bb.get() (#16378)
add 07d8e02367 [Unity][nnModule] Dynamic shape support in nn Module (#16284)
add 5c87bfe09b [Unity][Relax][Op] Add Conv3D Operator (#16385)
add e9bea9d2e2 [Relax][Frontend][ONNX]fix onnx frontend parse (#16395)
add 98d5153918 [Unity] PagedKVCache supporting on-the-fly RoPE calculation (#16396)
add cf14eddebb [Unity][Transform] Memory planning for dynamic-shape func return (#16111)
add a2a1b53402 [Unity] Split DecomposeOpsForTraining into two steps (#15954)
add ae8d398b88 [CI] In jenkins.cmd_utils.Sh.tee, check for failing subprocess (#16382)
add f1bf20a950 [RPC] Fix tuning on macOS and Windows (#15771) (#16357)
add 4258c864b9 [RUNTIME][RPC] Enable RPCObjectRef return in RPC (#16387)
add 196b413813 [Relay][Frontend][Torch] fix a typo mistake in nonzero_numpy (#16390)
add 3e52c3dba5 [CI] Remove NVIDIA_DISABLE_REQUIRE (#16384)
add fe9814c73e [OpenCL][CMake] Fix OpenCL tests compilation (#16394)
add a7dd32cc16 [DeviceAPI] Support querying total global memory (#16398)
add 68be158d35 [ROCm] Some fixes of ROCm codegen (#16404)
add 3053f65da7 Add NVIDIA Hopper H100 target tag (#16407)
add 12ad4fbcf4 [Relay][Frontend][Torch] fix pytorch frontend not support logical or (#16400)
new c8f2e304ab Merge branch 'main' into test-merge-unity
new 0c5ab8c13a update jenkisfile to enable non-unity tests
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (242587613a)
\
N -- N -- N refs/heads/test_all_cases_on_unity (0c5ab8c13a)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
3rdparty/cutlass_fpA_intB_gemm | 2 +-
3rdparty/flashinfer | 2 +-
CMakeLists.txt | 10 +-
ci/jenkins/docker-images.ini | 20 +-
ci/jenkins/generated/arm_jenkinsfile.groovy | 2 +-
ci/jenkins/generated/cortexm_jenkinsfile.groovy | 2 +-
ci/jenkins/generated/cpu_jenkinsfile.groovy | 3 +-
ci/jenkins/generated/docker_jenkinsfile.groovy | 2 +-
ci/jenkins/generated/gpu_jenkinsfile.groovy | 2 +-
ci/jenkins/generated/hexagon_jenkinsfile.groovy | 2 +-
ci/jenkins/generated/i386_jenkinsfile.groovy | 2 +-
ci/jenkins/generated/lint_jenkinsfile.groovy | 2 +-
.../generated/minimal_cross_isa_jenkinsfile.groovy | 2 +-
ci/jenkins/generated/minimal_jenkinsfile.groovy | 2 +-
ci/jenkins/generated/riscv_jenkinsfile.groovy | 2 +-
ci/jenkins/generated/wasm_jenkinsfile.groovy | 2 +-
ci/jenkins/unity_jenkinsfile.groovy | 108 +-
ci/scripts/jenkins/cmd_utils.py | 44 +-
cmake/modules/CUDA.cmake | 5 +
cmake/modules/OpenCL.cmake | 2 +-
cmake/modules/contrib/CUTLASS.cmake | 3 +
.../modules/contrib/vllm.cmake | 15 +-
cmake/utils/CCache.cmake | 23 +-
conda/recipe/meta.yaml | 2 +-
docker/install/ubuntu2004_install_python.sh | 2 +-
docker/install/ubuntu_install_boost.sh | 2 +-
docker/install/ubuntu_install_cmake_source.sh | 3 +-
docker/install/ubuntu_install_sccache.sh | 2 +-
docker/python/bootstrap-requirements.txt | 26 +-
docs/dev/how_to/relay_add_op.rst | 4 +-
docs/reference/langref/relay_expr.rst | 2 +-
include/tvm/ir/transform.h | 25 +
include/tvm/relax/analysis.h | 15 +
include/tvm/relax/attrs/nn.h | 45 +
include/tvm/relax/attrs/sorting.h | 99 ++
include/tvm/relax/attrs/statistical.h | 20 +-
include/tvm/relax/block_builder.h | 6 +-
include/tvm/relax/dataflow_matcher.h | 28 +
include/tvm/relax/dataflow_pattern.h | 9 +-
include/tvm/relax/struct_info.h | 4 +-
include/tvm/relax/transform.h | 9 +
include/tvm/runtime/c_runtime_api.h | 2 +-
include/tvm/runtime/device_api.h | 1 +
include/tvm/runtime/disco/builtin.h | 4 +-
include/tvm/runtime/disco/disco_worker.h | 2 +-
include/tvm/runtime/object.h | 4 +-
.../tvm/runtime/relax_vm/ndarray_cache_support.h | 10 +-
include/tvm/tir/analysis.h | 29 +-
include/tvm/tir/builtin.h | 6 +
include/tvm/tir/transform.h | 11 +-
include/tvm/topi/nn/rms_norm.h | 24 +-
include/tvm/topi/transform.h | 4 +-
licenses/LICENSE.vllm.txt | 201 +++
python/setup.py | 7 +-
python/tvm/_ffi/libinfo.py | 2 +-
python/tvm/_ffi/runtime_ctypes.py | 14 +
python/tvm/autotvm/tuner/__init__.py | 1 +
.../tuner/{droplet_turner.py => droplet_tuner.py} | 17 +-
python/tvm/contrib/cc.py | 2 +-
python/tvm/contrib/cutlass/gemm_operation.py | 7 +-
python/tvm/contrib/cutlass/gen_tensor_op.py | 1 +
python/tvm/contrib/emcc.py | 1 +
python/tvm/contrib/msc/core/codegen/codegen.py | 16 +-
.../tensorflow/tools => core/gym}/__init__.py | 7 +-
.../tvm/tools => core/gym/agent}/__init__.py | 6 +-
.../tvm/contrib/msc/core/gym/agent/base_agent.py | 314 +++++
python/tvm/contrib/msc/core/gym/agent/method.py | 80 ++
.../tvm/contrib/msc/core/gym/agent/search_agent.py | 180 +++
.../tvm/tools => core/gym/control}/__init__.py | 6 +-
.../tvm/contrib/msc/core/gym/control/configer.py | 97 ++
.../tvm/contrib/msc/core/gym/control/controller.py | 107 ++
.../tvm/contrib/msc/core/gym/control/namespace.py | 28 +-
python/tvm/contrib/msc/core/gym/control/service.py | 816 +++++++++++
python/tvm/contrib/msc/core/gym/control/worker.py | 216 +++
.../tools => core/gym/environment}/__init__.py | 7 +-
.../contrib/msc/core/gym/environment/base_env.py | 368 +++++
.../tvm/contrib/msc/core/gym/environment/method.py | 202 +++
.../contrib/msc/core/gym/environment/prune_env.py | 95 ++
.../msc/core/gym/environment/quantize_env.py | 99 ++
python/tvm/contrib/msc/core/runtime/runner.py | 40 +-
python/tvm/contrib/msc/core/tools/__init__.py | 2 +
.../tvm/tools => core/tools/distill}/__init__.py | 6 +-
.../contrib/msc/core/tools/distill/distiller.py | 261 ++++
.../tvm/contrib/msc/core/tools/distill/method.py | 72 +
python/tvm/contrib/msc/core/tools/prune/pruner.py | 54 +
.../tvm/tools => core/tools/quantize}/__init__.py | 6 +-
.../tvm/contrib/msc/core/tools/quantize/method.py | 472 +++++++
.../contrib/msc/core/tools/quantize/quantizer.py | 249 ++++
python/tvm/contrib/msc/core/tools/tool.py | 16 +
python/tvm/contrib/msc/core/utils/expr.py | 20 +
python/tvm/contrib/msc/core/utils/file.py | 15 +-
python/tvm/contrib/msc/core/utils/info.py | 4 +
python/tvm/contrib/msc/core/utils/log.py | 4 +
python/tvm/contrib/msc/core/utils/register.py | 172 +++
.../msc/framework/tensorflow/tools/__init__.py | 2 +
.../tools => tensorflow/tools/distill}/__init__.py | 5 +-
.../tensorflow/tools/distill/distiller.py | 55 +
.../tools/quantize}/__init__.py | 5 +-
.../tensorflow/tools/quantize/quantizer.py | 55 +
.../msc/framework/tensorrt/codegen/codegen.py | 19 +-
.../msc/framework/tensorrt/codegen/sources.py | 172 ++-
.../msc/framework/tensorrt/runtime/runner.py | 53 +
.../msc/framework/tensorrt/tools/__init__.py | 2 +
.../tools => tensorrt/tools/distill}/__init__.py | 5 +-
.../framework/tensorrt/tools/distill/distiller.py | 55 +
.../tools => tensorrt/tools/quantize}/__init__.py | 6 +-
.../framework/tensorrt/tools/quantize/method.py | 149 ++
.../framework/tensorrt/tools/quantize/quantizer.py | 366 +++++
.../contrib/msc/framework/torch/tools/__init__.py | 2 +
.../tools => torch/tools/distill}/__init__.py | 6 +-
.../msc/framework/torch/tools/distill/distiller.py | 144 ++
.../msc/framework/torch/tools/distill/method.py | 116 ++
.../tools => torch/tools/quantize}/__init__.py | 6 +-
.../msc/framework/torch/tools/quantize/method.py | 237 ++++
.../framework/torch/tools/quantize/quantizer.py | 55 +
.../contrib/msc/framework/tvm/codegen/codegen.py | 16 +-
.../contrib/msc/framework/tvm/tools/__init__.py | 2 +
.../framework/tvm/tools/{ => distill}/__init__.py | 5 +-
.../msc/framework/tvm/tools/distill/distiller.py | 55 +
.../tools => tvm/tools/quantize}/__init__.py | 6 +-
.../msc/framework/tvm/tools/quantize/method.py | 204 +++
.../msc/framework/tvm/tools/quantize/quantizer.py | 167 +++
python/tvm/contrib/msc/pipeline/manager.py | 62 +-
python/tvm/dlight/base/__init__.py | 3 +-
python/tvm/dlight/base/analysis.py | 28 +-
python/tvm/dlight/base/schedule_rule.py | 15 +
python/tvm/dlight/gpu/__init__.py | 1 +
.../tvm/dlight/gpu/base.py | 35 +-
python/tvm/dlight/gpu/fallback.py | 19 +-
python/tvm/dlight/gpu/gemv.py | 38 +-
python/tvm/dlight/gpu/general_reduction.py | 7 +-
python/tvm/dlight/gpu/matmul.py | 15 +-
python/tvm/dlight/gpu/reduction.py | 74 +-
python/tvm/dlight/gpu/rmsnorm.py | 140 ++
python/tvm/dlight/gpu/transpose.py | 11 +-
python/tvm/driver/build_module.py | 27 +-
python/tvm/driver/tvmc/compiler.py | 31 +-
python/tvm/ir/instrument.py | 18 +
python/tvm/ir/module.py | 1 -
python/tvm/relax/analysis/__init__.py | 1 +
python/tvm/relax/analysis/analysis.py | 25 +
python/tvm/relax/backend/__init__.py | 1 +
python/tvm/relax/backend/dispatch_sort_scan.py | 163 +++
python/tvm/relax/block_builder.py | 15 +-
python/tvm/relax/frontend/nn/__init__.py | 14 +-
python/tvm/relax/frontend/nn/_tensor_op.py | 16 +-
python/tvm/relax/frontend/nn/core.py | 415 +++---
python/tvm/relax/frontend/nn/exporter.py | 331 +++++
python/tvm/relax/frontend/nn/extern.py | 399 ++++++
python/tvm/relax/frontend/nn/modules.py | 100 +-
python/tvm/relax/frontend/nn/op.py | 407 ++++--
python/tvm/relax/frontend/nn/spec.py | 409 +-----
python/tvm/relax/frontend/onnx/onnx_frontend.py | 50 +-
python/tvm/relax/frontend/torch/fx_translator.py | 29 +
python/tvm/relax/op/__init__.py | 3 +-
python/tvm/relax/op/nn/__init__.py | 1 +
python/tvm/relax/op/nn/nn.py | 100 ++
python/tvm/relax/op/op_attrs.py | 21 +-
python/tvm/relax/op/sorting.py | 116 ++
python/tvm/relax/op/statistical.py | 72 +-
python/tvm/relax/pipeline.py | 5 +-
python/tvm/relax/transform/__init__.py | 4 +
.../tvm/relax/transform/attach_external_modules.py | 52 +
python/tvm/relax/transform/legalize_ops/index.py | 12 -
python/tvm/relax/transform/legalize_ops/nn.py | 41 +
.../relax/transform/legalize_ops/statistical.py | 11 +-
python/tvm/relax/transform/transform.py | 62 +-
python/tvm/relax/utils.py | 26 +-
python/tvm/relax/vm_build.py | 81 +-
python/tvm/relay/frontend/pytorch.py | 157 ++-
python/tvm/relay/frontend/qnn_torch.py | 11 +-
python/tvm/relay/frontend/tflite.py | 6 -
python/tvm/relay/op/contrib/clml.py | 118 +-
python/tvm/relay/op/strategy/generic.py | 52 +-
python/tvm/relay/testing/yolo_detection.py | 6 +-
python/tvm/rpc/server.py | 11 +-
python/tvm/runtime/disco/session.py | 2 +-
python/tvm/runtime/ndarray.py | 31 +-
python/tvm/runtime/relax_vm.py | 19 +-
python/tvm/script/ir_builder/relax/ir.py | 8 +
python/tvm/script/ir_builder/tir/ir.py | 2 +
python/tvm/target/detect_target.py | 23 +-
python/tvm/testing/utils.py | 20 +
python/tvm/tir/op.py | 17 +
python/tvm/tir/tensor_intrin/arm_cpu.py | 9 +-
python/tvm/tir/tensor_intrin/dot_product_common.py | 82 +-
python/tvm/tir/tensor_intrin/rocm.py | 3 +-
python/tvm/tir/transform/transform.py | 17 +-
python/tvm/topi/arm_cpu/arm_utils.py | 7 +-
python/tvm/topi/arm_cpu/conv2d_gemm.py | 16 +-
python/tvm/topi/cuda/sort.py | 1 -
python/tvm/topi/generic/nn.py | 34 +
python/tvm/topi/intel_graphics/conv2d.py | 3 +-
python/tvm/topi/math.py | 5 +-
python/tvm/topi/nn/conv1d_transpose.py | 142 +-
python/tvm/topi/nn/conv3d_transpose.py | 75 +
python/tvm/topi/testing/__init__.py | 5 +-
.../topi/testing/conv1d_transpose_ncw_python.py | 12 +
.../topi/testing/conv3d_transpose_ncdhw_python.py | 40 +-
src/arith/ir_mutator_with_analyzer.cc | 5 +-
src/arith/ir_visitor_with_analyzer.cc | 2 +-
src/contrib/msc/core/codegen/code_stack.cc | 198 ++-
src/contrib/msc/core/codegen/code_stack.h | 487 ++++---
src/contrib/msc/core/codegen/py_codegen.h | 50 +-
src/contrib/msc/core/printer/cpp_printer.cc | 139 +-
src/contrib/msc/core/printer/cpp_printer.h | 47 +-
src/contrib/msc/core/printer/msc_base_printer.cc | 8 +
src/contrib/msc/core/printer/msc_base_printer.h | 14 +
src/contrib/msc/core/printer/msc_doc.cc | 34 +
src/contrib/msc/core/printer/msc_doc.h | 186 ++-
src/contrib/msc/core/printer/print_utils.cc | 43 +-
src/contrib/msc/core/printer/print_utils.h | 134 +-
src/contrib/msc/core/printer/python_printer.cc | 68 +-
src/contrib/msc/core/printer/python_printer.h | 11 +-
src/contrib/msc/core/transform/layout_utils.cc | 26 +
src/contrib/msc/core/transform/layout_utils.h | 21 +
src/contrib/msc/core/transform/set_expr_layout.cc | 78 +-
src/contrib/msc/core/utils.cc | 15 +
src/contrib/msc/core/utils.h | 38 +
src/contrib/msc/framework/tensorflow/codegen.cc | 29 +-
.../msc/framework/tensorflow/tf_v1_opcode.cc | 49 +-
src/contrib/msc/framework/tensorrt/codegen.cc | 127 +-
.../msc/framework/tensorrt/tensorrt_opcode.cc | 35 +-
src/contrib/msc/framework/torch/codegen.cc | 12 +-
src/contrib/msc/framework/torch/torch_opcode.cc | 35 +-
src/contrib/msc/framework/tvm/codegen.cc | 63 +-
src/contrib/msc/framework/tvm/relax_opcode.cc | 37 +-
src/driver/driver_api.cc | 3 +-
src/ir/module.cc | 2 +-
src/ir/transform.cc | 31 +
src/meta_schedule/postproc/verify_gpu_code.cc | 2 +-
src/node/script_printer.cc | 31 +-
src/relax/analysis/computable_at_compile_time.cc | 99 ++
src/relax/analysis/struct_info_analysis.cc | 32 +-
src/relax/analysis/well_formed.cc | 27 +-
src/relax/ir/block_builder.cc | 43 +-
src/relax/ir/dataflow_matcher.cc | 23 +-
src/relax/ir/dataflow_pattern.cc | 6 +-
src/relax/ir/expr.cc | 6 +
src/relax/ir/expr_functor.cc | 12 +-
src/relax/ir/struct_info.cc | 5 +-
src/relax/op/ccl/ccl.cc | 11 +-
src/relax/op/distributed/distributed.cc | 5 +-
src/relax/op/image/resize.cc | 10 +-
src/relax/op/nn/attention.cc | 5 +-
src/relax/op/nn/convolution.cc | 216 ++-
src/relax/op/nn/convolution.h | 5 +
src/relax/op/nn/nn.cc | 50 +-
src/relax/op/nn/pooling.cc | 20 +-
src/relax/op/op_common.h | 25 +
src/relax/op/tensor/binary.cc | 20 +-
src/relax/op/tensor/create.cc | 5 +-
src/relax/op/tensor/index.cc | 49 +-
src/relax/op/tensor/linear_algebra.cc | 25 +-
src/relax/op/tensor/manipulate.cc | 290 +---
src/relax/op/tensor/search.cc | 22 +-
src/relax/op/tensor/set.cc | 39 +-
src/relax/op/tensor/sorting.cc | 155 +++
src/relax/op/tensor/sorting.h | 71 +
src/relax/op/tensor/statistical.cc | 100 +-
src/relax/op/tensor/statistical.h | 21 +-
src/relax/transform/adjust_matmul_order.cc | 176 +++
src/relax/transform/alter_op_impl.cc | 1 +
src/relax/transform/bundle_model_params.cc | 7 +-
src/relax/transform/call_tir_rewrite.cc | 39 +-
src/relax/transform/canonicalize_bindings.cc | 63 +-
src/relax/transform/convert_dataflow.cc | 151 ++
src/relax/transform/decompose_ops.cc | 156 +--
src/relax/transform/fuse_tir.cc | 261 ++--
src/relax/transform/lambda_lift.cc | 214 ++-
src/relax/transform/legalize_ops.cc | 42 +
src/relax/transform/meta_schedule.cc | 10 +-
src/relax/transform/static_plan_block_memory.cc | 174 ++-
src/relax/transform/update_param_struct_info.cc | 111 ++
src/relax/transform/utils.h | 23 +
src/relax/utils.cc | 18 +
src/relay/backend/contrib/clml/codegen.cc | 2 +-
src/relay/transforms/pattern_utils.h | 43 +-
src/relay/transforms/simplify_expr.cc | 2 +-
src/runtime/contrib/clml/clml_runtime.cc | 521 ++++---
src/runtime/contrib/cublas/cublas_json_runtime.cc | 1 -
src/runtime/contrib/cudnn/cudnn_json_runtime.cc | 1 -
src/runtime/contrib/cutlass/weight_preprocess.cc | 15 +-
src/runtime/contrib/miopen/conv_forward.cc | 21 +
src/runtime/contrib/thrust/thrust.cu | 245 ++--
src/runtime/contrib/vllm/attention_kernels.cu | 774 +++++++++++
src/runtime/contrib/vllm/attention_utils.cuh | 55 +
src/runtime/contrib/vllm/cache_alloc.cc | 55 +
src/runtime/contrib/vllm/cache_kernels.cu | 234 ++++
src/runtime/contrib/vllm/dtype_float16.h | 697 ++++++++++
src/runtime/cuda/cuda_common.h | 3 +
src/runtime/cuda/cuda_device_api.cc | 15 +-
src/runtime/disco/builtin.cc | 4 +-
src/runtime/disco/disco_worker.cc | 2 +-
src/runtime/metal/metal_device_api.mm | 12 +-
src/runtime/minrpc/minrpc_server.h | 15 +-
src/runtime/minrpc/rpc_reference.h | 8 +
src/runtime/opencl/opencl_device_api.cc | 10 +-
src/runtime/relax_vm/builtin.cc | 29 +
src/runtime/relax_vm/kv_cache.h | 183 +++
src/runtime/relax_vm/lm_support.cc | 44 +-
src/runtime/relax_vm/ndarray_cache_support.cc | 11 +-
src/runtime/relax_vm/paged_kv_cache.cc | 1454 ++++++++++++-------
src/runtime/relax_vm/vm.cc | 3 -
src/runtime/rocm/rocm_device_api.cc | 11 +-
src/runtime/rpc/rpc_endpoint.cc | 51 +-
src/runtime/rpc/rpc_local_session.cc | 20 +-
src/runtime/rpc/rpc_module.cc | 7 +
src/runtime/rpc/rpc_session.h | 51 +-
src/runtime/vulkan/vulkan_device_api.cc | 4 +
src/script/printer/relax/utils.h | 1 -
src/script/printer/tir/stmt.cc | 22 +-
src/support/errno_handling.h | 69 +
src/support/pipe.h | 42 +-
src/support/socket.h | 65 +-
src/target/llvm/codegen_llvm.cc | 2 +
src/target/llvm/intrin_rule_rocm.cc | 87 +-
src/target/llvm/llvm_instance.cc | 4 +
src/target/llvm/llvm_module.cc | 4 +
src/target/parsers/aprofile.cc | 12 +-
src/target/source/codegen_c.cc | 43 +-
src/target/source/codegen_cuda.cc | 2 +
src/target/source/literal/cuda_int8_t.h | 64 +
src/target/tag.cc | 26 +
src/te/operation/create_primfunc.cc | 19 +-
src/tir/analysis/verify_well_formed.cc | 212 +++
src/tir/ir/data_type_rewriter.cc | 7 +-
src/tir/ir/specialize.cc | 106 +-
src/tir/ir/tir_visitor_with_path.cc | 434 ++++++
src/tir/ir/tir_visitor_with_path.h | 210 +++
src/tir/op/builtin.cc | 4 +
src/tir/schedule/transform.cc | 28 +-
src/tir/transforms/compact_buffer_region.cc | 2 +-
src/tir/transforms/default_gpu_schedule.cc | 49 +-
src/tir/transforms/inline_private_functions.cc | 300 ++++
src/tir/transforms/ir_utils.cc | 54 +-
src/tir/transforms/loop_partition.cc | 35 +
src/tir/transforms/lower_thread_allreduce.cc | 2 +-
...tions.cc => merge_shared_memory_allocations.cc} | 115 +-
src/tir/transforms/split_host_device.cc | 2 +-
src/tir/transforms/storage_access.cc | 30 +-
src/tir/transforms/storage_rewrite.cc | 19 +-
src/tir/transforms/unify_thread_binding.cc | 3 +-
src/topi/transform.cc | 3 +-
tests/cpp/target/parsers/aprofile_test.cc | 27 +
tests/lint/check_file_type.py | 1 +
tests/python/codegen/test_target_codegen_cuda.py | 46 +
tests/python/codegen/test_target_codegen_rocm.py | 53 +
tests/python/contrib/test_clml/conftest.py | 21 +-
tests/python/contrib/test_clml/infrastructure.py | 242 ++--
tests/python/contrib/test_clml/test_network.py | 249 ++--
tests/python/contrib/test_clml/test_ops.py | 942 +++++++++----
.../test_hexagon/test_pass_fq2i_avg_pool2d.py | 115 +-
tests/python/contrib/test_msc/test_manager.py | 47 +-
tests/python/contrib/test_msc/test_runner.py | 33 +-
tests/python/contrib/test_msc/test_tools.py | 129 +-
tests/python/contrib/test_msc/test_transform.py | 156 +++
.../test_msc/test_transform_set_expr_layout.py | 73 -
.../test_msc/test_transform_set_expr_name.py | 108 --
.../contrib/test_msc/test_translate_relax.py | 262 ++--
.../contrib/test_msc/test_translate_relay.py | 2 +
tests/python/dlight/test_gpu_gemv.py | 161 ++-
tests/python/dlight/test_gpu_reduction.py | 86 +-
tests/python/dlight/test_gpu_rmsnorm.py | 287 ++++
tests/python/dlight/test_primitives.py | 60 +
tests/python/driver/tvmc/test_command_line.py | 41 +-
tests/python/frontend/pytorch/test_forward.py | 63 +
tests/python/frontend/pytorch/test_span_naming.py | 106 ++
tests/python/frontend/tflite/test_forward.py | 24 +-
tests/python/relax/frontend_nn_extern_module.cc | 69 +
.../test_analysis_computable_at_compile_time.py | 243 ++++
.../relax/test_backend_dispatch_sort_scan.py | 350 +++++
tests/python/relax/test_bind_params.py | 5 +-
tests/python/relax/test_blockbuilder_core.py | 204 ++-
tests/python/relax/test_contrib_vllm.py | 780 +++++++++++
tests/python/relax/test_dataflow_pattern.py | 9 +-
tests/python/relax/test_expr.py | 20 +
tests/python/relax/test_frontend_from_fx.py | 79 ++
tests/python/relax/test_frontend_nn_debug.py | 83 ++
.../python/relax/test_frontend_nn_extern_module.py | 363 +++--
tests/python/relax/test_frontend_nn_modules.py | 55 +-
tests/python/relax/test_frontend_nn_op.py | 175 ++-
tests/python/relax/test_frontend_nn_packing.py | 51 +-
tests/python/relax/test_frontend_nn_tensor.py | 10 +-
tests/python/relax/test_frontend_onnx.py | 17 +-
tests/python/relax/test_frontend_stablehlo.py | 4 +-
tests/python/relax/test_op_misc.py | 14 +-
tests/python/relax/test_op_nn_convolution.py | 187 +++
tests/python/relax/test_op_sort.py | 294 ++++
tests/python/relax/test_op_statistical.py | 53 +-
tests/python/relax/test_runtime_builtin.py | 41 +
...est_runtime_builtin_paged_attention_kv_cache.py | 426 ------
..._builtin_paged_attention_kv_cache_flashinfer.py | 469 +++++++
...runtime_builtin_paged_attention_kv_cache_tir.py | 1456 ++++++++++++++++++++
.../relax/test_transform_adjust_matmul_order.py | 351 +++++
tests/python/relax/test_transform_alter_op_impl.py | 100 ++
.../relax/test_transform_bundle_model_params.py | 91 ++
.../relax/test_transform_canonicalize_bindings.py | 324 ++++-
.../relax/test_transform_convert_dataflow.py | 493 +++++++
tests/python/relax/test_transform_decompose_ops.py | 71 +-
tests/python/relax/test_transform_fuse_tir.py | 14 +-
tests/python/relax/test_transform_lambda_lift.py | 97 +-
.../relax/test_transform_legalize_ops_grad.py | 4 -
..._transform_legalize_ops_index_linear_algebra.py | 90 +-
.../test_transform_legalize_ops_manipulate.py | 12 -
.../python/relax/test_transform_legalize_ops_nn.py | 100 +-
...st_transform_legalize_ops_search_statistical.py | 4 -
.../test_transform_static_plan_block_memory.py | 151 +-
.../test_transform_update_param_struct_info.py | 71 +
tests/python/relax/test_tvmscript_parser.py | 94 +-
.../python/relax/test_tvmscript_parser_op_sort.py | 60 +
.../relax/test_tvmscript_parser_op_statistical.py | 8 +-
tests/python/relax/test_vm_multi_device.py | 186 +++
tests/python/runtime/test_runtime_rpc.py | 31 +
.../test_tir_analysis_verify_well_formed.py | 148 +-
tests/python/tir-base/test_tir_specialize.py | 138 +-
.../python/tir-schedule/test_tir_schedule_error.py | 26 +-
.../tir-schedule/test_tir_schedule_tensorize.py | 50 +-
.../test_tir_inline_private_functions.py | 253 ++++
.../test_tir_transform_convert_ssa.py | 216 +++
.../test_tir_transform_inject_ptx_async_copy.py | 2 +-
.../test_tir_transform_loop_partition.py | 228 +++
...form_merge_dynamic_shared_memory_allocations.py | 65 +-
...sform_merge_static_shared_memory_allocations.py | 203 +++
.../tir-transform/test_tir_transform_simplify.py | 12 +
.../test_tir_transform_split_host_device.py | 72 +
.../test_transform_default_gpu_schedule.py | 73 +
.../topi/test_topi_group_conv1d_transpose_ncw.py | 110 ++
.../topi/test_topi_group_conv3d_transpose_ncdhw.py | 109 ++
.../tvmscript/test_tvmscript_printer_annotation.py | 25 +
tests/scripts/task_python_adreno.sh | 1 +
tests/scripts/task_show_node_info.sh | 1 +
version.py | 2 +-
web/Makefile | 2 +-
web/emcc/tvmjs_support.cc | 11 +-
web/emcc/wasm_runtime.cc | 4 +-
web/package.json | 4 +-
web/src/ctypes.ts | 5 +
web/src/runtime.ts | 33 +-
web/tests/node/test_packed_func.js | 15 +
440 files changed, 30019 insertions(+), 5875 deletions(-)
copy tests/python/contrib/test_clml/conftest.py => cmake/modules/contrib/vllm.cmake (71%)
create mode 100644 include/tvm/relax/attrs/sorting.h
create mode 100644 licenses/LICENSE.vllm.txt
rename python/tvm/autotvm/tuner/{droplet_turner.py => droplet_tuner.py} (88%)
copy python/tvm/contrib/msc/{framework/tensorflow/tools => core/gym}/__init__.py (88%)
copy python/tvm/contrib/msc/{framework/tvm/tools => core/gym/agent}/__init__.py (90%)
create mode 100644 python/tvm/contrib/msc/core/gym/agent/base_agent.py
create mode 100644 python/tvm/contrib/msc/core/gym/agent/method.py
create mode 100644 python/tvm/contrib/msc/core/gym/agent/search_agent.py
copy python/tvm/contrib/msc/{framework/tvm/tools => core/gym/control}/__init__.py (89%)
create mode 100644 python/tvm/contrib/msc/core/gym/control/configer.py
create mode 100644 python/tvm/contrib/msc/core/gym/control/controller.py
copy tests/python/contrib/test_clml/conftest.py => python/tvm/contrib/msc/core/gym/control/namespace.py (63%)
create mode 100644 python/tvm/contrib/msc/core/gym/control/service.py
create mode 100644 python/tvm/contrib/msc/core/gym/control/worker.py
copy python/tvm/contrib/msc/{framework/tensorflow/tools => core/gym/environment}/__init__.py (86%)
create mode 100644 python/tvm/contrib/msc/core/gym/environment/base_env.py
create mode 100644 python/tvm/contrib/msc/core/gym/environment/method.py
create mode 100644 python/tvm/contrib/msc/core/gym/environment/prune_env.py
create mode 100644 python/tvm/contrib/msc/core/gym/environment/quantize_env.py
copy python/tvm/contrib/msc/{framework/tvm/tools => core/tools/distill}/__init__.py (89%)
create mode 100644 python/tvm/contrib/msc/core/tools/distill/distiller.py
create mode 100644 python/tvm/contrib/msc/core/tools/distill/method.py
copy python/tvm/contrib/msc/{framework/tvm/tools => core/tools/quantize}/__init__.py (89%)
create mode 100644 python/tvm/contrib/msc/core/tools/quantize/method.py
create mode 100644 python/tvm/contrib/msc/core/tools/quantize/quantizer.py
copy python/tvm/contrib/msc/framework/{tvm/tools => tensorflow/tools/distill}/__init__.py (90%)
create mode 100644 python/tvm/contrib/msc/framework/tensorflow/tools/distill/distiller.py
copy python/tvm/contrib/msc/framework/{tvm/tools => tensorflow/tools/quantize}/__init__.py (90%)
create mode 100644 python/tvm/contrib/msc/framework/tensorflow/tools/quantize/quantizer.py
copy python/tvm/contrib/msc/framework/{tvm/tools => tensorrt/tools/distill}/__init__.py (90%)
create mode 100644 python/tvm/contrib/msc/framework/tensorrt/tools/distill/distiller.py
copy python/tvm/contrib/msc/framework/{tensorflow/tools => tensorrt/tools/quantize}/__init__.py (88%)
create mode 100644 python/tvm/contrib/msc/framework/tensorrt/tools/quantize/method.py
create mode 100644 python/tvm/contrib/msc/framework/tensorrt/tools/quantize/quantizer.py
copy python/tvm/contrib/msc/framework/{tensorflow/tools => torch/tools/distill}/__init__.py (88%)
create mode 100644 python/tvm/contrib/msc/framework/torch/tools/distill/distiller.py
create mode 100644 python/tvm/contrib/msc/framework/torch/tools/distill/method.py
copy python/tvm/contrib/msc/framework/{tensorflow/tools => torch/tools/quantize}/__init__.py (88%)
create mode 100644 python/tvm/contrib/msc/framework/torch/tools/quantize/method.py
create mode 100644 python/tvm/contrib/msc/framework/torch/tools/quantize/quantizer.py
copy python/tvm/contrib/msc/framework/tvm/tools/{ => distill}/__init__.py (90%)
create mode 100644 python/tvm/contrib/msc/framework/tvm/tools/distill/distiller.py
copy python/tvm/contrib/msc/framework/{tensorflow/tools => tvm/tools/quantize}/__init__.py (88%)
create mode 100644 python/tvm/contrib/msc/framework/tvm/tools/quantize/method.py
create mode 100644 python/tvm/contrib/msc/framework/tvm/tools/quantize/quantizer.py
copy docker/install/ubuntu_install_sccache.sh => python/tvm/dlight/gpu/base.py (52%)
mode change 100755 => 100644
create mode 100644 python/tvm/dlight/gpu/rmsnorm.py
create mode 100644 python/tvm/relax/backend/dispatch_sort_scan.py
create mode 100644 python/tvm/relax/frontend/nn/exporter.py
create mode 100644 python/tvm/relax/frontend/nn/extern.py
create mode 100644 python/tvm/relax/op/sorting.py
create mode 100644 python/tvm/relax/transform/attach_external_modules.py
create mode 100644 src/relax/analysis/computable_at_compile_time.cc
create mode 100644 src/relax/op/tensor/sorting.cc
create mode 100644 src/relax/op/tensor/sorting.h
create mode 100644 src/relax/transform/adjust_matmul_order.cc
create mode 100644 src/relax/transform/convert_dataflow.cc
create mode 100644 src/relax/transform/update_param_struct_info.cc
create mode 100644 src/runtime/contrib/vllm/attention_kernels.cu
create mode 100644 src/runtime/contrib/vllm/attention_utils.cuh
create mode 100644 src/runtime/contrib/vllm/cache_alloc.cc
create mode 100644 src/runtime/contrib/vllm/cache_kernels.cu
create mode 100644 src/runtime/contrib/vllm/dtype_float16.h
create mode 100644 src/runtime/relax_vm/kv_cache.h
create mode 100644 src/support/errno_handling.h
create mode 100644 src/target/source/literal/cuda_int8_t.h
create mode 100644 src/tir/ir/tir_visitor_with_path.cc
create mode 100644 src/tir/ir/tir_visitor_with_path.h
create mode 100644 src/tir/transforms/inline_private_functions.cc
rename src/tir/transforms/{merge_dynamic_shared_memory_allocations.cc => merge_shared_memory_allocations.cc} (82%)
create mode 100644 tests/python/contrib/test_msc/test_transform.py
delete mode 100644 tests/python/contrib/test_msc/test_transform_set_expr_layout.py
delete mode 100644 tests/python/contrib/test_msc/test_transform_set_expr_name.py
create mode 100644 tests/python/dlight/test_gpu_rmsnorm.py
create mode 100644 tests/python/dlight/test_primitives.py
create mode 100644 tests/python/frontend/pytorch/test_span_naming.py
create mode 100644 tests/python/relax/frontend_nn_extern_module.cc
create mode 100644 tests/python/relax/test_analysis_computable_at_compile_time.py
create mode 100644 tests/python/relax/test_backend_dispatch_sort_scan.py
create mode 100644 tests/python/relax/test_contrib_vllm.py
create mode 100644 tests/python/relax/test_frontend_nn_debug.py
create mode 100644 tests/python/relax/test_op_sort.py
delete mode 100644 tests/python/relax/test_runtime_builtin_paged_attention_kv_cache.py
create mode 100644 tests/python/relax/test_runtime_builtin_paged_attention_kv_cache_flashinfer.py
create mode 100644 tests/python/relax/test_runtime_builtin_paged_attention_kv_cache_tir.py
create mode 100644 tests/python/relax/test_transform_adjust_matmul_order.py
create mode 100644 tests/python/relax/test_transform_convert_dataflow.py
create mode 100644 tests/python/relax/test_transform_update_param_struct_info.py
create mode 100644 tests/python/relax/test_tvmscript_parser_op_sort.py
create mode 100644 tests/python/relax/test_vm_multi_device.py
create mode 100644 tests/python/tir-transform/test_tir_inline_private_functions.py
create mode 100644 tests/python/tir-transform/test_tir_transform_merge_static_shared_memory_allocations.py
create mode 100644 tests/python/topi/test_topi_group_conv1d_transpose_ncw.py
create mode 100644 tests/python/topi/test_topi_group_conv3d_transpose_ncdhw.py
(tvm) 02/02: update jenkisfile to enable non-unity tests
Posted by sy...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
syfeng pushed a commit to branch test_all_cases_on_unity
in repository https://gitbox.apache.org/repos/asf/tvm.git
commit 0c5ab8c13a46afc085a563c10c819b476f817ad6
Author: Siyuan Feng <hz...@sjtu.edu.cn>
AuthorDate: Wed Jan 17 14:14:43 2024 +0800
update jenkisfile to enable non-unity tests
---
ci/jenkins/generated/arm_jenkinsfile.groovy | 4 ----
ci/jenkins/generated/cortexm_jenkinsfile.groovy | 4 ----
ci/jenkins/generated/cpu_jenkinsfile.groovy | 4 ----
ci/jenkins/generated/docker_jenkinsfile.groovy | 4 ----
ci/jenkins/generated/gpu_jenkinsfile.groovy | 10 +++-------
ci/jenkins/generated/hexagon_jenkinsfile.groovy | 4 ----
ci/jenkins/generated/i386_jenkinsfile.groovy | 4 ----
ci/jenkins/generated/lint_jenkinsfile.groovy | 4 ----
ci/jenkins/generated/minimal_cross_isa_jenkinsfile.groovy | 4 ----
ci/jenkins/generated/minimal_jenkinsfile.groovy | 4 ----
ci/jenkins/generated/riscv_jenkinsfile.groovy | 4 ----
ci/jenkins/generated/wasm_jenkinsfile.groovy | 4 ----
12 files changed, 3 insertions(+), 51 deletions(-)
diff --git a/ci/jenkins/generated/arm_jenkinsfile.groovy b/ci/jenkins/generated/arm_jenkinsfile.groovy
index 919b39e402..2c522fa2a1 100644
--- a/ci/jenkins/generated/arm_jenkinsfile.groovy
+++ b/ci/jenkins/generated/arm_jenkinsfile.groovy
@@ -54,10 +54,6 @@
// - Periodically cleanup the old versions on local workers
//
-// unity: Skip less relevant tests
-// to reduce ci time and resource cost
-// (DO NOT UPSTREAM TO MAIN)
-return
// ============================= IMPORTANT NOTE =============================
// This file is generated by 'jenkins/generate.py'. Do not edit this file directly!
diff --git a/ci/jenkins/generated/cortexm_jenkinsfile.groovy b/ci/jenkins/generated/cortexm_jenkinsfile.groovy
index c195f0b0e7..3f1e3249cb 100644
--- a/ci/jenkins/generated/cortexm_jenkinsfile.groovy
+++ b/ci/jenkins/generated/cortexm_jenkinsfile.groovy
@@ -54,10 +54,6 @@
// - Periodically cleanup the old versions on local workers
//
-// unity: Skip less relevant tests
-// to reduce ci time and resource cost
-// (DO NOT UPSTREAM TO MAIN)
-return
// ============================= IMPORTANT NOTE =============================
// This file is generated by 'jenkins/generate.py'. Do not edit this file directly!
diff --git a/ci/jenkins/generated/cpu_jenkinsfile.groovy b/ci/jenkins/generated/cpu_jenkinsfile.groovy
index 7010d60191..4788aebdda 100644
--- a/ci/jenkins/generated/cpu_jenkinsfile.groovy
+++ b/ci/jenkins/generated/cpu_jenkinsfile.groovy
@@ -54,10 +54,6 @@
// - Periodically cleanup the old versions on local workers
//
-// unity: Skip less relevant tests
-// to reduce ci time and resource cost
-// (DO NOT UPSTREAM TO MAIN)
-return
// ============================= IMPORTANT NOTE =============================
// This file is generated by 'jenkins/generate.py'. Do not edit this file directly!
diff --git a/ci/jenkins/generated/docker_jenkinsfile.groovy b/ci/jenkins/generated/docker_jenkinsfile.groovy
index 091751bfb0..6b3fba8b8c 100644
--- a/ci/jenkins/generated/docker_jenkinsfile.groovy
+++ b/ci/jenkins/generated/docker_jenkinsfile.groovy
@@ -54,10 +54,6 @@
// - Periodically cleanup the old versions on local workers
//
-// unity: Skip less relevant tests
-// to reduce ci time and resource cost
-// (DO NOT UPSTREAM TO MAIN)
-return
// ============================= IMPORTANT NOTE =============================
// This file is generated by 'jenkins/generate.py'. Do not edit this file directly!
diff --git a/ci/jenkins/generated/gpu_jenkinsfile.groovy b/ci/jenkins/generated/gpu_jenkinsfile.groovy
index 32fbeab3ba..1ea8e2ca87 100644
--- a/ci/jenkins/generated/gpu_jenkinsfile.groovy
+++ b/ci/jenkins/generated/gpu_jenkinsfile.groovy
@@ -54,10 +54,6 @@
// - Periodically cleanup the old versions on local workers
//
-// unity: Skip less relevant tests
-// to reduce ci time and resource cost
-// (DO NOT UPSTREAM TO MAIN)
-return
// ============================= IMPORTANT NOTE =============================
// This file is generated by 'jenkins/generate.py'. Do not edit this file directly!
@@ -565,7 +561,7 @@ def build(node_type) {
cmake_build("${ci_gpu} --no-gpu", 'build', '-j2')
make_standalone_crt("${ci_gpu} --no-gpu", 'build')
sh(
- script: "./${jenkins_scripts_root}/s3.py --action upload --bucket ${s3_bucket} --prefix ${s3_prefix}/gpu --items build/libtvm.so build/libvta_fsim.so build/libtvm_runtime.so build/config.cmake build/libtvm_allvisible.so build/microtvm_template_projects build/crttest build/standalone_crt build/build.ninja",
+ script: "./${jenkins_scripts_root}/s3.py --action upload --bucket ${s3_bucket} --prefix ${s3_prefix}/gpu --items build/libtvm.so build/libvta_fsim.so build/libtvm_runtime.so build/config.cmake build/libtvm_allvisible.so build/microtvm_template_projects build/crttest build/standalone_crt build/build.ninja build/3rdparty/libflash_attn/src/libflash_attn.so build/3rdparty/cutlass_fpA_intB_gemm/cutlass_kernels/libfpA_intB_gemm.so",
label: 'Upload artifacts to S3',
)
@@ -576,7 +572,7 @@ def build(node_type) {
cmake_build("${ci_gpu} --no-gpu", 'build', '-j2')
make_standalone_crt("${ci_gpu} --no-gpu", 'build')
sh(
- script: "./${jenkins_scripts_root}/s3.py --action upload --bucket ${s3_bucket} --prefix ${s3_prefix}/gpu2 --items build/libtvm.so build/libtvm_runtime.so build/config.cmake build/crttest build/standalone_crt build/build.ninja",
+ script: "./${jenkins_scripts_root}/s3.py --action upload --bucket ${s3_bucket} --prefix ${s3_prefix}/gpu2 --items build/libtvm.so build/libtvm_runtime.so build/config.cmake build/crttest build/standalone_crt build/build.ninja build/3rdparty/libflash_attn/src/libflash_attn.so build/3rdparty/cutlass_fpA_intB_gemm/cutlass_kernels/libfpA_intB_gemm.so",
label: 'Upload artifacts to S3',
)
})
@@ -589,7 +585,7 @@ def build(node_type) {
}
}
try {
- build('CPU-SMALL-SPOT')
+ build('CPU')
} catch (Exception ex) {
build('CPU-SMALL')
}
diff --git a/ci/jenkins/generated/hexagon_jenkinsfile.groovy b/ci/jenkins/generated/hexagon_jenkinsfile.groovy
index c86389d1bd..d6153b4666 100644
--- a/ci/jenkins/generated/hexagon_jenkinsfile.groovy
+++ b/ci/jenkins/generated/hexagon_jenkinsfile.groovy
@@ -54,10 +54,6 @@
// - Periodically cleanup the old versions on local workers
//
-// unity: Skip less relevant tests
-// to reduce ci time and resource cost
-// (DO NOT UPSTREAM TO MAIN)
-return
// ============================= IMPORTANT NOTE =============================
// This file is generated by 'jenkins/generate.py'. Do not edit this file directly!
diff --git a/ci/jenkins/generated/i386_jenkinsfile.groovy b/ci/jenkins/generated/i386_jenkinsfile.groovy
index 4afc8fb64f..4ac67d1687 100644
--- a/ci/jenkins/generated/i386_jenkinsfile.groovy
+++ b/ci/jenkins/generated/i386_jenkinsfile.groovy
@@ -54,10 +54,6 @@
// - Periodically cleanup the old versions on local workers
//
-// unity: Skip less relevant tests
-// to reduce ci time and resource cost
-// (DO NOT UPSTREAM TO MAIN)
-return
// ============================= IMPORTANT NOTE =============================
// This file is generated by 'jenkins/generate.py'. Do not edit this file directly!
diff --git a/ci/jenkins/generated/lint_jenkinsfile.groovy b/ci/jenkins/generated/lint_jenkinsfile.groovy
index 88bec7fc4c..44e3430003 100644
--- a/ci/jenkins/generated/lint_jenkinsfile.groovy
+++ b/ci/jenkins/generated/lint_jenkinsfile.groovy
@@ -54,10 +54,6 @@
// - Periodically cleanup the old versions on local workers
//
-// unity: Skip less relevant tests
-// to reduce ci time and resource cost
-// (DO NOT UPSTREAM TO MAIN)
-return
// ============================= IMPORTANT NOTE =============================
// This file is generated by 'jenkins/generate.py'. Do not edit this file directly!
diff --git a/ci/jenkins/generated/minimal_cross_isa_jenkinsfile.groovy b/ci/jenkins/generated/minimal_cross_isa_jenkinsfile.groovy
index f26eaace67..c962f9a138 100644
--- a/ci/jenkins/generated/minimal_cross_isa_jenkinsfile.groovy
+++ b/ci/jenkins/generated/minimal_cross_isa_jenkinsfile.groovy
@@ -54,10 +54,6 @@
// - Periodically cleanup the old versions on local workers
//
-// unity: Skip less relevant tests
-// to reduce ci time and resource cost
-// (DO NOT UPSTREAM TO MAIN)
-return
// ============================= IMPORTANT NOTE =============================
// This file is generated by 'jenkins/generate.py'. Do not edit this file directly!
diff --git a/ci/jenkins/generated/minimal_jenkinsfile.groovy b/ci/jenkins/generated/minimal_jenkinsfile.groovy
index 89e6a0c59e..e5fb778f95 100644
--- a/ci/jenkins/generated/minimal_jenkinsfile.groovy
+++ b/ci/jenkins/generated/minimal_jenkinsfile.groovy
@@ -54,10 +54,6 @@
// - Periodically cleanup the old versions on local workers
//
-// unity: Skip less relevant tests
-// to reduce ci time and resource cost
-// (DO NOT UPSTREAM TO MAIN)
-return
// ============================= IMPORTANT NOTE =============================
// This file is generated by 'jenkins/generate.py'. Do not edit this file directly!
diff --git a/ci/jenkins/generated/riscv_jenkinsfile.groovy b/ci/jenkins/generated/riscv_jenkinsfile.groovy
index fce33f230e..f86a78e95d 100644
--- a/ci/jenkins/generated/riscv_jenkinsfile.groovy
+++ b/ci/jenkins/generated/riscv_jenkinsfile.groovy
@@ -54,10 +54,6 @@
// - Periodically cleanup the old versions on local workers
//
-// unity: Skip less relevant tests
-// to reduce ci time and resource cost
-// (DO NOT UPSTREAM TO MAIN)
-return
// ============================= IMPORTANT NOTE =============================
// This file is generated by 'jenkins/generate.py'. Do not edit this file directly!
diff --git a/ci/jenkins/generated/wasm_jenkinsfile.groovy b/ci/jenkins/generated/wasm_jenkinsfile.groovy
index e47fdd4cd5..c777596501 100644
--- a/ci/jenkins/generated/wasm_jenkinsfile.groovy
+++ b/ci/jenkins/generated/wasm_jenkinsfile.groovy
@@ -54,10 +54,6 @@
// - Periodically cleanup the old versions on local workers
//
-// unity: Skip less relevant tests
-// to reduce ci time and resource cost
-// (DO NOT UPSTREAM TO MAIN)
-return
// ============================= IMPORTANT NOTE =============================
// This file is generated by 'jenkins/generate.py'. Do not edit this file directly!
(tvm) 01/02: Merge branch 'main' into test-merge-unity
Posted by sy...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
syfeng pushed a commit to branch test_all_cases_on_unity
in repository https://gitbox.apache.org/repos/asf/tvm.git
commit c8f2e304abb76b3a11d78ad3f458d44bbf37f197
Merge: a2a1b53402 12ad4fbcf4
Author: Siyuan Feng <hz...@sjtu.edu.cn>
AuthorDate: Wed Jan 17 13:49:01 2024 +0800
Merge branch 'main' into test-merge-unity
ci/jenkins/generated/arm_jenkinsfile.groovy | 4 +-
ci/jenkins/generated/cortexm_jenkinsfile.groovy | 4 +-
ci/jenkins/generated/cpu_jenkinsfile.groovy | 4 +-
ci/jenkins/generated/docker_jenkinsfile.groovy | 4 +-
ci/jenkins/generated/gpu_jenkinsfile.groovy | 4 +-
ci/jenkins/generated/hexagon_jenkinsfile.groovy | 4 +-
ci/jenkins/generated/i386_jenkinsfile.groovy | 4 +-
ci/jenkins/generated/lint_jenkinsfile.groovy | 4 +-
.../generated/minimal_cross_isa_jenkinsfile.groovy | 4 +-
ci/jenkins/generated/minimal_jenkinsfile.groovy | 4 +-
ci/jenkins/generated/riscv_jenkinsfile.groovy | 4 +-
ci/jenkins/generated/wasm_jenkinsfile.groovy | 4 +-
ci/jenkins/templates/utils/base.groovy.j2 | 2 +-
ci/scripts/jenkins/cmd_utils.py | 44 ++++++++---
cmake/modules/OpenCL.cmake | 2 +-
include/tvm/runtime/device_api.h | 1 +
include/tvm/runtime/object.h | 4 +-
python/tvm/_ffi/runtime_ctypes.py | 14 ++++
python/tvm/relay/frontend/pytorch.py | 9 ++-
python/tvm/rpc/server.py | 11 +--
src/runtime/cuda/cuda_device_api.cc | 10 ++-
src/runtime/metal/metal_device_api.mm | 4 +
src/runtime/minrpc/minrpc_server.h | 15 +++-
src/runtime/minrpc/rpc_reference.h | 8 ++
src/runtime/opencl/opencl_device_api.cc | 10 ++-
src/runtime/rocm/rocm_device_api.cc | 11 ++-
src/runtime/rpc/rpc_endpoint.cc | 51 +++++++++++--
src/runtime/rpc/rpc_local_session.cc | 20 ++++-
src/runtime/rpc/rpc_module.cc | 7 ++
src/runtime/rpc/rpc_session.h | 51 ++++++++++++-
src/runtime/vulkan/vulkan_device_api.cc | 4 +
src/target/llvm/codegen_llvm.cc | 2 +
src/target/llvm/intrin_rule_rocm.cc | 87 +++++++++++++---------
src/target/tag.cc | 2 +
src/tir/transforms/lower_thread_allreduce.cc | 2 +-
tests/python/codegen/test_target_codegen_rocm.py | 53 +++++++++++++
tests/python/frontend/pytorch/test_forward.py | 16 ++++
tests/python/runtime/test_runtime_rpc.py | 31 ++++++++
38 files changed, 426 insertions(+), 93 deletions(-)