17 Oct 15:36

ysh329

22a9d38

Apache TVM v0.18.0 Latest

Latest

Introduction

The TVM community has worked since the last release to deliver the following new exciting improvements!

The main tags are below (bold text is with lots of progress):

Frontend: PyTorch's ExportedProgram is supported in the relax frontend ( #17346)
Community, RFCs
AOT, Hexagon， OpenCL & CLML, Web, Metal
Relax, Dlight, Disco
TIR, TVMScript
Docs, Docker, CI, Misc, BugFix

Please visit the full listing of commits for a complete view: v0.18.dev0...v0.18.0.rc0.

Community

#17450 - update contributors

RFCs

The new RFC introduces a new backend Android Neural Network API (NNAPI) for BYOC. It is a graph-level neural network inference API provided by the Android runtime. Prior to this RFC, TVM on Android mobile devices mainly relies on OpenCL for GPU acceleration. This RFC aims to add a new codegen and a runtime via the BYOC framework, which enables execution on custom accelerators from SoC vendors on mobile devices.

#109 - [RFC] NNAPI Integration via BYOC

BYOC

#17385 - [NNAPI] Add NNAPI backend for BYOC

BugFix

#17440 - [TIR][Schedule] TileWithTensorIntrin skip ComputeInline if bu…
#17419 - [FFI]Grab GIL when check env signals
#17403 - [Fix][LLVM] Fix getHostCPUFeatures LLVM version cutoff
#17383 - [ONNX] Skip constant If node generated by PyTorch
#17360 - [FIX] fix bug when normalize iter with different lower bounds
#17148 - [Relax] Preserve existing DataflowBlock in ConvertToDataflow
#17345 - [Fix][Relax] Add the missing tree-attn func arg for KV cache creation
#17073 - [Relax]FCallPacked not checked in CodegenVMTIR
#17315 - [MSC]Bugfix for strided_slice op
#17335 - [Relax][PyTorch][Fix] use_convert_torch_tensor_to_relax() where possible
#17330 - [Relax][PyTorch]Update layer_norm converter to support immutable_list for normalized_shape
#17324 - [Fix] Remove tvm. prefix from image name when ./docker/build.sh
#17308 - [TVM4J]Fix unhandled return type in JNI
#17307 - [Fix][TIR] LowerThreadAllreduce warp reduction mask
#17312 - [Relax]Infer TIR values from shapes inside a tuple
#17292 - [Relax]Support torch.unbind op and fix bugs for expand && split
#17263 - [Relax]Preserve dtype in ToMixedPrecision for kNever ops
#17229 - [Cutlass] fix cutlass instantiate attention template bugs
#17121 - [Relax]Fix a bug about the IR construction in test file
#17142 - Allow import of TVM when current directory is read-only

CI

#17444 - [Docs] Upgrade Sphinx
#17425 - Upgrade CI to Python 3.9
#17410 - Upgrade unity image tag to 20240917-153130-9f281758
#17409 - [Windows] Workaround for error in FindLLVM
#17397 - Update image tag to 20240917-153130-9f281758
#17338 - Upgrade PyTorch to 2.4.1
#17337 - Disable NNPACK build and fix error on Android SDK installaion
#17355 - Upgrade github upload-artifact action
#17334 - [Hexagon] Forward gtest tests into pytest as separate tests
#17271 - Resolve CI compilation failures on MacOSX
#17221 - Reduce logging level when checking if docker image exists
#17206 - Update dummy-variable regex for pylint
#17117 - [CLML]Fix for few clml regression issues
#17155 - Remove lint step from unity/pr-head step

Disco

#17398 - Enable float8 data type in disco
#17275 - Fix double free of nccl communicator
#17264 - Disable splitting nccl communicator in single-group
#17182 - Implement SocketSession
#17191 - Cross-group and p2p send/receive primitives
#17180 - Group-wise operation

Dlight

#17430 - [GPU] Improve matmul schedule for adreno
#17363 - Fix Matmul rule for Conv3D
#17259 - [ADRENO] Fix for opencl adreno matmul schedule
#17187 - [GPU] Add OpenCL dequant matmul schedule

Docker

#17433 - [CI] Add NNEF dependency to CI images

Docs

#17436 - [Relax][PyTorch]Use torch.export insteamd of fx.symbolic_trace for tutorial
#17402 - [Doc] Update Architecture Overview
#17382 - More clarity on security model of RPC server
#17380 - [Doc] Relax Deep Dive
#17377 - Update document to include security model of RPC server
#17378 - Link to project-specific security page
#17352 - TVM pip Installation fix
#17343 - Minor fix typo in developer howto guide
#17328 - [Doc] Deep Dive TensorIR
#17327 - [Doc] How to Optimize a Language Model
#17320 - [Doc] Customize Optimization
#17319 - [Doc] Fix doc build error in e2e_opt_model.py
#17306 - [Doc] Refactor How-To
#17296 - [Doc] Overview
#17298 - [Doc] IRModule
#17286 - Introduce Relax API and move legacy part to standalone page
#17289 - [Doc] Quick Start
#17287 - [Doc] Refactor install docs

Frontend

#17431 - [Relax][Onnx] Add support for pad-2
#17447 - [ONNX] Move relax related tests to the correct file
#17427 - [Relax][ONNX] Expand op support for ONNX frontend
#17429 - [Relax][PyTorch] Support tensor manipulation and creation ops for ExportedProgram importer
#17426 - [Relax][PyTorch] Support neural network ops for ExportedProgram importer
#17424 - [Relax][PyTorch] Support binary, statistical and search ops for ExportedProgram importer
#17421 - [Relax][PyTorch] Support more unary ops for ExportedProgram importer
#17396 - [Relax][PyTorch] Add support for torch.export.ExportedProgram in Relax PyTorch Frontend
#17379 - [Relax][PyTorch] Fix output shape of torch.nn.functional.scaled_dot_product_attention
#17376 - [Relax][PyTorch] Cleanup Tensor Manipulation and Creation op converters
#17372 - [Relax][PyTorch] Cleanup Statistical, Search and DataType op converters
#17369 - [Relax][PyTorch] Cleanup Neural Network op converters
#17366 - [Relax][PyTorch] Cleanup binary op converters
#17356 - [Relax][PyTorch] Cleanup unary op converters
#17350 - [Relax][Onnx] fix params name bug in onnx frontend
#17342 - [Relax][PyTorch] Add support for torch.ops.aten.sym_size.int
#17300 - [Relax][PyTorch] Add support for torchvision.ops.stochastic_depth
#17325 - [Relax][PyTorch] Add support for `torc...

Assets 5

20 Jul 09:43

ysh329

v0.17.0

eeebcfa

Apache TVM v0.17.0

Introduction

The TVM community has worked since the v0.17.0 release to deliver the following new exciting improvements! This release version is:

The main tags are below (bold text is with lots of progress):

Community, RFCs
AOT, Hexagon， OpenCL & CLML, Web, Metal
Relax, Dlight, Disco
TIR, TVMScript
Docs, CI, Misc, BugFix

Please visit the full listing of commits for a complete view: v0.17.dev0...v0.17.0.rc0.

Community

#17018 - New committer: Balint Cristian

RFCs

This new RFC added an open, standardized format for neural network exchange developed by the Khronos Group since 2018 (https://www.khronos.org/nnef). It is aimed at deploying trained neural networks from deep learning frameworks to proprietary inference engines of neural network hardware vendors.

#108 - [RFC] Add NNEF frontend

AOT

#17077 - Correctly calculate workspace for vector types

Adreno

#16927 - [SCRIPT]Fix in build config for adreno

BYOC

#16895 - Add layout check and update shape check for cublas FP8 BYOC

BugFix

#17138 - [Fix][TIR] Fix outdated call to create extern buffer in make_extern
#17132 - Restrict CopyOnWrite to _type_final
#17096 - Update FAttrsGetter to return Map<String, ObjectRef>
#17078 - [NCCL] Release NCCL thread_local resources in destructor
#17044 - [Support] Fix copy constructor for support::OrderedSet
#17000 - [MSC] split name_string with index by colon from the right
#16923 - [Fix][Dlight] Fix GeneralReduction for log-sum-exp
#16924 - [Fix] Fix SSA conversion for SizeVar retention
#16903 - CudaDeviceAPI::GetAttr may check kExist when GPUs absent
#16901 - rocm shared memory issue on MI250

CI

#17055 - [SME][Test] Add additional conv2d tests for asymmetric parameters
#17007 - [TOPI][Testing] Enable conv2d NHWC fp16 topi testing for arm_cpu
#16930 - [UnitTest] Use pytest's scope='session' for tvm.testing.parameter
#16948 - Update image tag to 20240428-060115-0b09ed018
#16931 - Use LLVM17 for tests on ci_cpu
#16942 - Enable Conda setup v3
#16939 - Upgrade CUDA to 12.4

CRT

#17097 - [Bugfix]Return error code on error from ModuleGetFunction

Disco

#17035 - [QoL] Implement broadcast/scatter methods for Session
#16992 - [Bugfix]Handle NDArray larger than OS buffer for pipe
#16978 - Implement num_workers property for disco.Session
#16989 - Treat hangup of disco worker process as kShutdown
#16993 - Allow allocation that only exists on worker0
#16979 - Expose disco.Session.shutdown through the python API
#16919 - Improve error message for CallPacked

Dlight

#17082 - Use 16x32 spatial x reduction thread extents in GEMV scheduling
#17052 - Skip GEMV rules when more than one vector
#17026 - Perf improvement for low_batch_gemv on Metal
#17016 - Update Adreno GEMV Rules
#16972 - [GPU] Enhance opencl thread limit for schedules
#16973 - [GPU] Improved gemv outer fallback schedule
#16958 - Check for target in function attributes
#16894 - Enhance vectorization for gpu matmul
#16884 - Add check for matmul dtype and fix reduction rule

Docs

#17146 - [DOC] Fix typo for the "We utilize the intermediate representation of nn.Graph to convert the OneFlow model to Reley."
#17015 - [DOC] Update Model Links to Include Commit

Frontend

#17014 - [ArgParse] Pass default values to target compiler(#13264)
#16961 - [Bugfix][ONNX] Improve broadcast and batch_matmul conversion
#16936 - [TFLite] Add support for GELU conversion

Hexagon

#17123 - Add support for v75

LLVM

#17046 - [Arith][SVE] Add rewrite rules for indices split by scalable expressions
#16966 - [SVE] Add support for representing and creating buffer-level predicates
#17001 - [SVE] Use only powers of two as possible vscale values
#16962 - [SVE] Add codegen support for vscale_range() function attribute
#16968 - Stringref API deprecation fixes
#16965 - [SVE] Add get_active_lane_mask builtin
#16899 - [SVE][TOPI] Add conv2d NHWC hybrid SVE schedule for arm_cpu
#16893 - [SVE] Check for SVE target in VectorizeLoop
#16862 - [SVE] Support splitting by vscale in tir::split and te::split

MetaSchedule

#17012 - [BugFix]MultiLevelTilingTensorCore generates inconsistent thread-binding sketch for batched matmul
#17066 - [BugFix]Fix TensorIntrin ‘dot_4x4_i8i8s32_sdot’ is not registered

Metal

#17059 - Enable Debug Label
#17025 - Support metal device profiling

OpenCL & CLML

#16933 - [CLML] Fix in clml pattern check condition
#16929 - [VM][OPENCL] Take advantage of OpenCL host ptr for improved copy

ROCm

#17141 - [Backend]Fix error when building TVM with LLVM 19

Relax

#17139 - Fix cublas dispatch for corner cases
#17127 - [KVCache] Support fork in sliding window sink part
#17115 - Support input_axis_separator to allow 2D to 1D conversion
#17119 - [Bugfix]Set purity=false for LazySetOutput
#17118 - [VM] Improved error messages for mismatched parameter count
#17110 - Alloc BYOC workspace with R.builtin.alloc_tensor
#17089 - [ONNX] Add support for HardSigmoid
#17100 - [KVCache] Unlimited depth blocks
#17075 - [Transform] Modify FuseTIR pass to propagate buffer attributes
#17088 - [ONNX] Add support for HardSwish
#17085 - [PyTorch] Add support for torch.nn.Hardsigmoid
#17083 - [TVMScript]Preserve tir.SizeVar through TVMScript round-trip
#17086 - Ignore dynamic parameters in RewriteDataflowReshape
#17084 - [PyTorch] Add support for torch.nn.Hardswish
#17074 - [KVCache][Test] Fix TIR attn kernels for uncommon group size
#17067 - Add missing white spaces in error messages
#17061 - [Frontend][Onnx] Cast Op special handling for ShapeExpr input
#17033 - [Bugfix] Apply FuseOps to nested DataflowBlock
#17032 - [Bugfix] Annotate ComputePrimValue output as host function
#17034 - [Bugfix] Bind symbolic variables in R.match_cast
#16960 - [UnitTest] Validate IRModule with multiple targets
#16995 - [KVCache] Support KVCache decode from forked sequence an...

Assets 5

28 Apr 07:18

ysh329

v0.16.0

6496903

Apache TVM v0.16.0

Introduction

The TVM community has worked since the v0.15.0 release to deliver the following new exciting improvements! This release version is:

First support of Relax, with dynamic shape and pipeline
Dlight module for optimizing LLM TIR workloads on GPU
Disco module for initial SPMD multi-GPU support

The main tags are below (bold text is with lots of progress):

Community, RFCs
Adreno, ArmComputeLibrary, Metal, cuda & cutlass & tensorrt, micoNPU, Runtime
Relax, Dlight, Disco
Arith, TIR, TVMScript
Docs, CI, Misc, BugFix

Please visit the full listing of commits for a complete view: v0.16.dev0...v0.16.0.rc0.

Community

#16695 - Add new key for release signing
#16419 - Add new key for release signing

RFCs

This new RFC explores how TVM can be utilized to generate code for the SME ISA to achieve improved inference performance on supported Arm®-based hardware implementing the SME extension.

#107 - [RFC] Scalable Matrix Extension enablement

Arith

#16735 - [Fixup] Require feature flag for tighter inequality bounds
#16588 - Provide tighter ConstIntBounds for special cases
#16704 - [Fix]Fix canonical simplification of LE

BYOC

#16567 - Skip processed functions in FuseOpsByPattern and RunCodegen

BugFix

#16766 - [Target] Added null check to fix segfault at ->defined() in cpu.cc DetectSystemTriple()
#16739 - [Ansor] Fixing Ansor Gradient Bug
#16820 - [Fix] PAPI docs
#16793 - [Fix] fix for numpy 2.0 compatibility
#16790 - [Fix] Fix build errors with VS2022
#16780 - [Fix] Fix numpy dtype map
#16773 - [Fix] Fix the purity flag of "vm.call_tir_dyn" and "kill" ops
#16770 - [Hotfix] Revert driver API pass ordering that breaks MLC, mark failing test
#16771 - [Fix] Remove redundant "remove_all_unused" in IPC memory lowering
#16746 - [Fix][Builtin] Fix "GetQueryPosition" of PagedKVCache
#16728 - [Fix] Introduce TVM_DEBUG_WITH_ABI_CHANGE to warn ABI changes in debug mode
#16714 - [Fix] PagedKVCache fetching compute stream when copy stream is needed
#16684 - [SLM] Produce well-formed Relax for nn.modules.KVCache
#16659 - add the default value for DFT in ONNX frontend
#16637 - [Transform] Preserve symbolic variables in FuseOps
#16649 - [FFI] Add a missing default for datatype lanes
#16492 - [Executor] fix debug_executor function debug_get_output
#16598 - [Transform]Handle non-composite lambda functions in FuseOps
#16565 - [Transform] Keep private non-primitive functions in FuseTIR
#16518 - Use xxx instead of pow(x,3)
#16436 - Ensure that bf16 arrays are created as expected
#16361 - Disable SingleEnvThreadVerifier
#16289 - [AUTOTVM][FIX] Typo fixes and add a warning in the Droplet Search

CI

#16837 - Disable flaky unit test
#16765 - [AOT][Testing] Improve output mismatch information on test failure
#16661 - add merge_with_main in unity
#16611 - [AOT][Testing] Print output values on test failure
#16546 - Disable testing that downloads from mxnet
#16521 - Fix CI Script and Broken Tests
#16502 - Support tvm-bot rerun for tvm-unity task
#16435 - Update image tag to 20240126-070121-8ade9c30e
#16420 - [WASM] Update emsdk and nodejs version
#16384 - Remove NVIDIA_DISABLE_REQUIRE
#16382 - In jenkins.cmd_utils.Sh.tee, check for failing subprocess
#16366 - Upgrade sccache version to 0.7.*
#16369 - Upgrade Unity ci images
#16344 - Update docker images tag to 20240105-165030-51bdaec6
#16340 - [Unity][UnitTest] Increase atol to resolve flaky CI failure
#16337 - [Hexagon][UnitTest] Disable flaky quantization test
#16336 - Upgrade cmake version to 3.24.0

Docker

#16755 - [SME]Add Fixed Virtual Platform (FVP) and toolchain install
#16348 - Upgrade pip in i386 container

Disco

#16618 - [Disco] Propagate structlog configuration to disco workers
#16639 - [Disco] Expose functions to query the per-worker device/rank
#16617 - [Disco] Implement Session.import_python_module method
#16715 - [Disco] Propagate structlog/logging config to workers
#16845 - [Debug][Disco] Check if a PackedFunc exists before calling it
#16817 - [Disco] Reduce Process/ThreadSession message queue reads and writes
#16807 - [Disco] Support setting workers' CPU affinity
#16375 - [Unity] Fix creation of disco ProcessSession
#16821 - [Fix] Add TVM_DLL to Disco session
#16752 - [Fix] Lazy import of "psutil" in disco process pool

Dlight

#16775 - [Fix][Dlight] (Low-batched-)GeMV on small spatial loops
#16429 - [Unity][Dlight][Fix] Reduction rule support dyn-shape epilogue
#16351 - [Unity] Add dlight.gpu.Fallback in DispatchSortScan, add argsort, topk, and cumprod
#16338 - [Unity][DLight] Introduce Specific Rule for RMSNorm
#16251 - [Unity][Dlight] Support dlight gemv rule on nested inner block
#16878 - [Dlight] Enhance vectorization loading weight for gemv
#16848 - [DLight] Fix a corner case for reduction rule
#16701 - [Dlight] Add fallback for low batch gemv with outer reduction
#16678 - [Dlight] LowBatchGemv rule only apply to function with spatial symbolic var
#16665 - [Dlight] Skip GeMV when normalization fails
#16579 - [Dlight] Scheduling Low batch GEMM using GEMV-like rule
#16579 - [Dlight] Scheduling Low batch GEMM using GEMV-like rule
#16321 - [DLight] Skip rule if target is not suitable
#16731 - [Dlight] Fix GeMV shared memory estimation

Docs

#16792 - [Doc] Fix set_axis_separator example
#16610 - [Doc] Fixed Docstring usage example in tvm.ir.make_node
#16572 - [Doc] Remove MxNet related tutorials
#16514 - [Unity][Doc] Document passes that depend on DataflowBlocks and encourage using ConvertToDataflow
#16482 - [Doc] Fix Docstring in extern.py for Sphinx
#16346 - [Doc] Fix minor error in "Expressions in Relay"

Frontend

#16001 - [ONNX] Fix interpreting auto_pad parameters in ConvTranspose operator
#16651 - [PaddlePaddle] PaddlePaddle model with NCHW data format that supports quantization
#16616 - [PaddlePaddle] Support conv2d when data_format is NHWC
[#16526](https://github.com/a...

Assets 5

19 Jan 00:56

ysh329

v0.15.0

a340dbe

Apache TVM v0.15.0

Introduction

NOTE: This is last release version before unity branch switch as main branch. No unity features.

The TVM community has worked since the v0.14.0 release to deliver the following new exciting improvements! The main tags are below (bold text is with lots of progress):

Community, RFCs
Adreno, ArmComputeLibrary, Metal, cuda & cutlass & tensorrt, micoNPU, Runtime
Frontend & Relay
Arith, TOPI, TIR, TVMScript
Docs, CI, Misc, BugFix

Please visit the full listing of commits for a complete view: v0.14.0...v0.15.0.

Community

#16172 - Yixin Dong -> Reviewer
#16162 - Shuai Yuan -> Committer
#16164 - Qiang Zhang -> Committer
#16166 - Bohan Hou -> PMC
#16165 - Ruihang Lai -> PMC

RFCs

#105 - Add a new backend language——SYCL

Adreno

#15991 - [CI] Enhancements to Adreno specific CI utils
#15786 - [TOPI] Add conv2d transpose nchw texture schedule

Arith

#16227 - Simplify nested if_then_else when constant is appearing in then_expr

ArmComputeLibrary

#15990 - [ACL] Update Compute Library to v23.08

Metal

#16192 - [Device] Fix metal warp size
#16033 - [Codegen] Disable cross-function call in Metal codegen

cuda & cutlass & tensorrt

#16061 - [CUDA] Add an option for profiling cuda kernels

micoNPU

#16003 - [microNPU][ETHOSU] Fix ConcatRewriter args processing
#15929 - [microNPU][ETHOSU] Fix rounding mode in requantize operation

Runtime

#15896 - [CLML] Fix for CLML ops and enable more test case
#16133 - Parallel-for with threading backend
#16066 - Support clear global memory allocators
#16030 - Introduce TVM_MODULE_VTABLE Macros

BugFix

#16269 - Update pillow usage
#16272 - Fixed Inappropriate Logical Expression
#16216 - [TIR] Fix dynamic smem merge leaf alloc
#16190 - Fix the error of reloading the model library on the ROCm platform: "MIOpen Error: No invoker was registered for convolution forward.”
#16167 - [Relay][Pytorch] Fix missing .dtype
#16091 - [Fix] Fix topi.rms_norm with float32 upscale
#16081 - [Fix] Broken Windows Build with LLVM
#16051 - [Fix][TIR] Fix dtype issues for match_buffer and ramp node
#14655 - [VTA] Fix FSIM compile error on macOS
#16021 - [FFI] Typo fix of IncRef to DecRef
#16010 - [Fix][TIR] fix mul dtype mismatch
#16000 - [Fix][TIR] fix symbolic strides lower
#15970 - [Hotfix] Mark python-FFI handling with TVM_DLL
#15965 - [CI] Better to pass the build folder

CI

#16110 - Refactor unittest folder
#16055 - Fix broken links about Jenkins
#16062 - Use LLVM 17 for tests on ci_arm
#16018 - [Tests] Fix work_dir location used by test_micro_tuning_with_meta_schedule
#16019 - [Tests] Check int8+int32 testcases in test_estimate_peak_flops_cpu
#16017 - [Tests] Fix str vs. int comparison in test_num_threads

Docs

#16282 - [Doc] Fix minor error in doc (Add an operator to Relay)
#16152 - [DOC] Add v0.14.0 docs to site
#16127 - Revert "[#15157][Rust][Doc] Re-enable the Rust documentation build (#15213)"
#16097 - Add missing backtick to contribute/code_guide.rst
#16089 - Fix error on linting by adding --rev argument
#16024 - Update release_process.rst about version number modification

Frontend & Relay

#16243 - [TFLite] Add support for quantized mirror pad
#15914 - [TFLite]Support quantized SQUARE
#16159 - [KERAS] Fix bug concat convert for NCHW
#16319 - [Torch] add aten:broadcast_to
#16131 - [Pytorch] Add support for aten::unflatten
#16105 - [Pytorch] Add support for aten::bitwise_and
#16079 - [Pytorch] Add support for aten::swapaxes operator
#15502 - [Pytorch] aten::copy_ support for pytorch
#16180 - [Pytorch] Fix bug when converting models with torch.nn.ParameterList
#16143 - [Pytorch] Add support for aten::scaled_dot_product_attention
#16123 - [Pytorch] Add support for aten::linalg_vector_norm
#16171 - [Frontend] Preserve Pytorch Span Names
#16217 - [Frontend][QNN] fix access param_debug_name_map to node output name in fx-quantized graph node replacement
#16199 - [Frontend] Add support for aten::concat
#16151 - conv3d depthwise bug fix
#15928 - Expose qnn ops directly from relay.qnn module

TOPI

#16259 - Add support for group_conv3d_transpose_ncdhw for generic
#16052 - Enhance topi.nn.matmul
#16080 - Reduce code redundancy in conv2d weights transformation
#16248 - [TOPI] Add support for group_conv1d_transpose_ncw for generic
#16106 - [TOPI] Add conv2d NHWC hybrid schedule for arm_cpu

TIR

#16239 - [Schedule] TileWithTensorIntrin skip incorrect ComputeInline for input-padding
#16236 - ConvertSSA process entry func first
#16070 - [Transform] Introduce new InjectPermutedLayout pass
#16083 - Enhance Python Type Annotations for TIR Expr
#16073 - Support more mma intrinsics and get_mma_intrin_group utility
#16076 - Enhance Python Type Annotations for TIR stmt
#16074 - Fix the thread binding iter_var dtype in Bind primitive
#16063 - Fix pass RenewDefs error in gather/take case
#16027 - Fix software pipeline with dynamic loop extent

TVMScript

#16271 - Disable concise scoping when the scope stmt is explicitly annotated
#16041 - Fix mismatched dtype of IterVar in T.thread_binding
#15953 - [TIR] Pretty print TIR LLVM function name
#15972 - delete print extra info at parsing

Misc

#16279 - replace deprecated np.int with int to avoid crash
#16262 - Update conv2d.py
#16255 - [Support] Add Interrupt Handling in Pipe
#16104 - [LoopPartition] Fix a bug of LoopPartition in single point scenarioes
#16231 - [Target] Add Jetson AGX Orin tags
#16221 - remove deprecated np.int in slice converter (pytorch)
#16214 - [Python] Fix setup.py for inplace build
#16174 - Bump cryptography from 37.0.2 to 41.0.6 in /docker/python
[#16202](#16...

Assets 5

23 Oct 07:41

Hzfengsy

v0.14.0

7315c9d

Apache TVM v0.14.0

Introduction

The TVM community has worked since the v0.13.0 release to deliver the following new exciting improvements! The main tags are below (bold text is with lots of progress):

Community, RFC
Arith, MetaSchedule
Adreno, ArmComputeLibrary, Hexagon, Metal, OpenCL & CLML, ROCm, Vulkan, cuda & cutlass & tensorrt, micoNPU, web
Runtime, TVMC, AOT, LLVM, microTVM, CMSIS-NN
Frontend, Relay, BYOC
TOPI, TIR, TVMScript
Docs, CI, Docker
Misc, , BugFix

Please visit the full listing of commits for a complete view: v0.13.0...v0.14.0.

Community

#15307 - Qingchao Shen -> Reviewer
#15619 - community strategy decision process

RFC

#102 - [Process RFC] Clarify Community Strategy Decision Process

AOT

#15301 - Avoid call_extern() with incorrect argument count
#15181 - Remove workaround to help resolve test flakiness

Adreno

#15830 - Minor changes for Adreno docs and help scripts
#15671 - [VM]Fix using buffers for weights in VM
#15391 - Small fixes in Adreno schedules

Arith

#15881 - Simplify the result of non-divisible floordiv
#15665 - Fix detect non-divisible iteration form like (x % 255) // 16
#15638 - MLIR PresburgerSet compile fix mlir >= 160
#15628 - Added simplification rule for multiple equality compares
#15558 - Fix detect linear equation with uint var
#14690 - Add tvm::arith::PresburgerSetNode to work with Presburger Set in MLIR
#15555 - Fix handling of overlapping predicates
#15471 - Enhance Canonical Simplify for LE
#15228 - Enhance buffer shape bound deduction to include offset

ArmComputeLibrary

#15600 - [ACL] Update Compute Library to v23.05.1
#15344 - [ACL] Update Compute Library to v23.05

BugFix

#15891 - [Relay]fix axis parsing of repeat converter in the MXNet frontend
#15873 - [Fix] Remove duplicated words from comments, NFC
#15868 - [Relay]Fix conv transpose with default strides in ONNX frontend
#15773 - [CPP] Fix cpp deploy bug
#15778 - [Hotfix] Fix Windows Pipe
#15748 - Move symbols that are relevant to the runtime from libtvm to…
#15752 - [Relay]fix the wrong calculate logic of operator flip in PyTorch frontend
#15715 - [Relay]Fix the wrong implementation about operator Threshold in oneflow
#15711 - [Strategy] Fix arm_cpu int8 conv2d strategy for dotprod and i8mm targets
#15717 - [Relay]fix the wrong implementation of Softplus in OneFlow
#15677 - [Arith] IterMapRewriter abort rewriting once failure
#15629 - [VTA] tvm.tir.Call has no name attribute
#15584 - [Relay][Strategy] Enable compile time transformation of weights matrix for arm_cpu NHWC quantized conv2d
#15542 - [Fix] Fix the typo in compile flag
#15484 - [TOPI] Fix a bug in arm_cpu int8 conv2d i8mm schedule
#15473 - [Relay] Fix some bugs of dominator pattern
#15478 - [TIR] ThreadSync with shared.dyn awareness
#15406 - [TIR]Ensure the Var's scope is correct
#15399 - [TIR] Fix multi-grouped multi-warp allreduce
#15350 - [Relay] fix a bug of printing dataflow pattern
#15385 - Work around "Internal Compiler Error" in MSVC
#15294 - [Bug][Relay] fix relay frontend pytorch op addmm bug
#15323 - [Fix][TIR] LowerThreadAllreduce with correct thread mask
#15291 - [Relay][GraphExecutor] Fix set_input_zero_copy() precision bug
#15225 - Fix function to read all file

CI

#15903 - [Target]Add LLVM functions for current system info
#15897 - [ADRENO] Few updates to Adreno docker setup
#15836 - Update ci-gpu image
#15668 - Allow Limit CPUs in Docker
#15568 - [Testing] Allow Capitalized name in CompareBeforeAfter
#15519 - [TEST] Run tests/python/relay/aot tests in ci-cortexm
#15485 - Remove cython version pin
#15421 - Bump Flax and Jaxlib versions to fix Jaxlib install error
#15226 - Add ml_dypes dependency for all docker images
#15353 - Pin cython version to fix cython compilation
#15352 - Make Graviton3 default AArch64 job runner node
#15339 - Update test to include unique attribute
#15277 - [Testing] Return BenchmarkResult in local_run and rpc_run
#15268 - [Testing] Add tvm.testing.local_run
#15136 - [UnitTest][NVPTX] Avoid cascading failures from CUDA postproc

CMSIS-NN

#15747 - Move CMSIS_5 from SHA to release based upgrade
#15407 - Support for Softmax Int16 operator

Docker

#15799 - Add LLVM 17 to the LLVM install script
#15862 - Upgrade oneflow to v0.8.0
#15819 - Install oneflow from PyPi
#15310 - Update ci-cortexm docker image
#15293 - tensorflow_aarch64 package upgrade

Docs

#15619 - community strategy decision process
#15508 - Add v0.13.0 docs to site
#15213 - [#15157][Rust][Doc] Re-enable the Rust documentation build

Frontend

#15821 - [TFLite]Support quantized ELU
#15844 - [TFLite]Fix test failures caused by div-by-zero
#15798 - [TFLite]Support quantized Pow
#15829 - [Relay][Keras][Bugfix] fix the converters of GRU and SimpleRNN about the go_backwards attribute
#15838 - Fix unnecessary pylint errors
#15802 - [SkipCI][Hotfix][TFLite] Disable test of quantized floor mod
#15790 - [TFLite]Support quantized LESS_EQUAL
#15775 - [TFLite]Support quantized GREATER_EQUAL
#15769 - [TFLite]Support quantized NOT_EQUAL
#15768 - [TFLite]Support quantized div
#15746 - [TFLite]Support quantized LESS
#15733 - [TFLite]Support quantized floor_mod
#15724 - [TFLite]Support quantized floor_div
#15602 - [ONNX][BugFix] Support If body with free variable from graph input
#15472 - [Relay][TFLite] Fix in qnn.conv2d when parameter groups not equal to 1
#15117 - [TFLITE] Add support for TFLite's regular NMS operator
#15415 - [ONNX] add onnx Mish operator
#15422 - [Keras] Add support for swish actiivation
#15370 - [Relay][Pytorch...

Assets 5

14 Jul 02:37

Hzfengsy

v0.13.0

97c5de6

Apache TVM v0.13.0

Introduction

The TVM community has worked since the v0.12.0 release to deliver the following new exciting improvements! The main tags are below (bold text is with lots of progress):

Community, RFC;
Frontend: TensorFlow/TFLite, Pytorch/Torch, Paddle, keras;
Runtime: Adreno, OpenCL & CLML, ROCm, CUDA & CUTLASS & TensorRT, Ethosn, Vulkan, Hexagon, Metal, others about runtime;
Relay, BYOC, TOPI, Arith, TIR, TVMScript, MetaSchedule;
microTVM, AOT, TVMC, LLVM;
CI, BugFix, Docs, Docker, Miscs;

Please visit the full listing of commits for a complete view: v0.12.0...v0.13.0.

Community

#15086 - Aleksei-grovety -> Reviewer
#14676 - Jiajun Jiang -> Reviewer
#14677 - Qiang Zhang -> Reviewer
#14622 - Sunghyun Park -> Reviewer
#14578 - Zihao Ye -> Committer
#14853 - Anirudh Sundar Subramaniam -> Committer
#14772 - Add new key for release signing

RFC

apache/tvm-rfcs#100

Frontend

#14830 - Use f-strings for string formatting, NFC
Keras
- #15122 - [Relay][Keras] Fix SeparableConv2D conversion in dilation_rate attribute
- #15107 - [Relay][Keras] Fix a wrong variable name in keras frontend
- #15053 - [Relay][Keras] Fix the wrong implementation logic about cropping2D
- #15082 - [Relay][Keras] Fix UpSampling2D about the wrong assertion about size
- #15060 - [Relay][keras] Fix the bug about the attribute 'output_padding' in Deconv
- #14707 - [Keras]fix a bug about alpha attribute in LeakyReLU which lead to passes conflict
- #15175 - [Relay][Keras] Fix concatenate convert function in axis parsing
Paddle
- #14801 - [Paddle] [PaddlePaddle Hackathon 4]add attribute support for gaussian_random/softplus/Conv3d/Conv2d
- #14973 - [Paddle] [PaddlePaddle Hackathon 4] add convert support for tanhshrink/pool3d/set_value ops for paddle frontend
- #14826 - [Paddle] [PaddlePaddle Hackathon 4] add convert support for p_norm/roi_align/softmax_with_cross_entropy
- #14575 - [Paddle] [PaddlePaddle Hackathon 4]add attribute support for dropout/hard_sigmoid/pixel_shuffle
TFLite
- #14667 - [TFLite]Support for quantized squared difference
- #14819 - [TFLite]Generate name when tensor name is missing
- #15173 - [FRONTEND][TFLITE]Fix int16 transpose conv loading
TensorFlow
- #14546 - [Tensorflow] Fix conv2d_transpose for NHWC layout
PyTorch
- #14747 - [PyTorch] Add aten::new_zeros
- #14699 - [Torch] fix typo in new_full
- #14963 - [PyTorch] Support use_input_stats in instance_norm
- #14930 - Fix pytorch axis
ONNX
- #15017 - [ONNX] Fix bug in scatter_elements

Runtime

#15182 - Add weak symbol to builtin fp16
#15161 - Clean TVM stacktrace in error messages
#15162 - Support void as dtype in FFI
#14902 - Update Module and Registry to use String Container
#14967 - [Runtime,RPC] Use f-strings for string formatting, NFC
#14887 - Make systemlib unique per prefix
#14775 - Added str for tvm._ffi.runtime_ctypes.TVMArray
#14656 - Fix Can't "query_imports" Bug of VM Executable

Adreno

#15061 - [TOPI]Fix problem with ceil_log2
#14996 - [OpenCL]Fix conv2d when output channels < 4

CMSIS-NN

#15059 - Update CMSIS-NN release to v4.1.0

OpenCL & CLML

#14972 - [OPENCL] Always use convert_T for type conversion
#14995 - [OpenCL] Improve diagnostic message
#14833 - [Codegen][OpenCL] fix amibiguous selection operator call
#14792 - [OpenCL] Refactor OpenCL runtime to support SPIRV binary ingestion
#14922 - [OpenCLML] Reactor and introduce on chip memory and memory planner
#14949 - [CodegenC] Updated unit test for sorted CodegenC output
#14767 - [OpenCLML] Transposed convolution support and other fixes

cuda & cutlass & tensorrt

#14751 - [CUDA] Fixed the call of the min function in the schedule for cuda
#14798 - [CUTLASS] Add NDEBUG option to CUTLASS compile to speed up attention kernel
#14782 - [Bugfix][Codegen][CUDA] Wrong casting in ASM

metal

#14962 - Fix int8 vectorized cast
#14846 - Fix vectorized select
#14727 - Update metal runtime to directly store kernel map
#14671 - Fix flaky memory issue due to racing

Vulkan

#15035 - [Vulkan] Allow DeclBuffer in CodeGenSPIRV
#14817 - [Vulkan] Add cooperative matrix support

Hexagon

#14997 - Remove "c" as aot_host_target tvm/contrib/hexagon/pytest_pl…
#14948 - Update instructions to compile hexagon runtime
#14965 - Add support for v73, make v68 default
#14720 - [TIR] Add get_vtcm_allocation_sizes with lowering
#14567 - [TIR] Use the "target" value in T.func_attr for VTCM limit

ROCm

#15106 - [TensorIR]AMD Matrix Core Support
#15088 - [Target]Replace rocm arch parsing from int to string

microTVM

#14872 - Use self.close_transport() on error

AOT

#15033 - Avoid Var-to-Var Let binding in AOTExecutorCodegen
#15032 - Remove duplication in tvm.testing.aot.compile_models
#14529 - Fix warning on dropping const in TVMAotExecutor_GetInputName

micoNPU

#15159 - [microNPU][ETHOSU] Fix compiler attributes types
#15147 - [microNPU][ETHOSU] Add option to disable copying constants for case without cascader
#15069 - [microNPU][ETHOSU] Fix SoftMax legalization parameters
#15115 - [microNPU][ETHOSU] Upgrade to 23.05 version of Arm(R) Ethos(TM)-U NPU drivers
#15114 - [microNPU] Upgrade Vela to v3.8.0
#15104 - [microNPU][ETHOSU] Fix minimum buffer size
#15063 - [microNPU][ETHOSU] Fix CopyComputeReordering pass arguments
#14861 - [microNPU][ETHOSU] Add offloading to the NPU the nn.avg_pool2d operator with a stride > 3
#14765 - [microNPU][ETHOSU] Channel pad offloaded to NPU
#14774 - [microNPU][ETHOSU] Fix Softmax quantization parameters
#14629 - [microNPU][ETHOSU] Softmax int8 legalization support
#14353 - [microNPU] Add support for MEAN with uint8 ifm
#14587 - [microNPU] Fix skip tests when Vela is not present
#14464 - [microNPU][ETHOSU] Add restrictions to convert to NHCWB16 layout in LayoutOptimization pass

BYOC

#15046 - Add GEMM kernel from FasterTransformer as submodule
#15029 - Hide internal cutlass symbols

Re...

Assets 5

17 May 07:08

Hzfengsy

v0.12.0

47e0440

Apache TVM v0.12.0

Introduction

The TVM community has worked since the v0.11.1 release to deliver the following new exciting improvements! The main tags are below (bold text is with lots of progress):

Community, RFC;
Runtime: ACL(ArmComputeLibrary), Adreno, OpenCL & CLML, ROCm, CUDA & CUTLASS & TensorRT, Ethosn, CRT, Hexagon, Metal, Web & WASM, others about runtime;
Frontend: TensorFlow/tflite, Pytorch/Torch, Paddle, OneFlow, keras;
TE, Relay, BYOC, TOPI, Arith, TIR, TVMScript, MetaSchedule, Schedule;
CI, Tests, BugFix, Docs, Docker, Build;
Android, microTVM, Target, AutoTVM, AOT, LLVM.

Please visit the full listing of commits for a complete view: v0.11.1...v0.12.0.

Thanks @ysh329 for the great effort to the release process as the release manager.

Community

RFC

Runtime

ArmComputeLibrary

Adreno

OpenCL & CLML

ROCm

[ROCM] Fixes compiling on ROCM 5 and accuracy on dense op

CMSIS-NN

CUDA & CUTLASS & TensorRT

Ethosn

CRT

Hexagon

Metal

MicroNPU

[microNPU] Sum legalization support
[microNPU] Add rescale parameters for binary elementwise
[microNPU] Add hardware constraints for binary elementwise
[microNPU] Add support for TFLite PAD
[microNPU] Upgrade Vela to v3.7.0
[microNPU] Merge LUT activation with binary elementwise operation
[microNPU] Upgrade to 22.08 version of Arm(R) Ethos(TM)-U NPU drivers
[microNPU] Add relu6 relu_n1_to_1 test cases for Ethos-U
[microNPU] Add a legalization test for TFLite PAD
[[microNPU] Disable copying weights to SRAM for FullyConnected ops in CopyConstants scheduler](https://github.com/ap...

Contributors

ysh329

Assets 5

09 Mar 19:47

leandron

v0.11.1

046910a

Apache TVM v0.11.1

Introduction

This is a v0.11.1 bug fix release on top of v0.11.0 (see #13899), incorporating a fix to the Python dependencies description.

What's Changed

Python dependencies

Add typing_extensions requirement (#14244)
Adjust version to 0.11.1 (#14300)

Assets 5

25 Feb 11:33

leandron

v0.11.0

cd9193a

Apache TVM v0.11.0

Introduction

The TVM community has worked since the v0.10.0 release to deliver the following new exciting improvements!

Metaschedule
- Tuning API improvements and anchor-block tuning
TVMSCript metaprogramming
- Lots of progress wiht TVMScript, with the introduction of a core parser, AST, Evaluator, Source and diagnostics

And many other general improvements to microTVM, code quality, CI, frontends, and more! Please visit the full listing of commits for a complete view: v0.10.0...v0.11.0.

RFCs

These RFCs have been merged in apache/tvm-rfcs since the last release.

CodeGenAArch64 backend with Scalable Vector Extension (SVE) #94 apache/tvm-rfcs@04b9909

What's Changed

Note that this list is not comprehensive of all PRs and discussions since v0.10. Please visit the full listing of commits for a complete view: v0.10.0...v0.11.0.

Adreno

[Adreno] Add global pooling schedule (#13573)
[Adreno] Add documentation for Adreno deployment (#13393)
[Adreno] Fix mem_scope annotations for prim funcs having several heads (#13153)
[Adreno] Adapt reduction schedule for adreno (#13100)
[Adreno] Fix winograd accuracy (#13117)
[Adreno][Textures] Fix static memory planner (#13253)
[DOCKER][Adreno]Docker infra for Adreno target with CLML support (#12833)

AoT

[AOT] Add CreateExecutorMetadata analysis pass (#13250)
[AOT] Add CreateFunctionMetadata analysis pass (#13095)
[AOT] Sanitize input/output name in runtime (#13046)

Arith

[Arith] Add internal NarrowPredicateExpression utility (#13041)
[Arith] Optional rewriting and simplification into AND of ORs (#12972)

arm

[bfloat16] Fixed dtype conversion in the arm_cpu injective schedule (#13417)

AutoTVM

[AutoTVM] Introducing multi_filter into ConfigSpace autotvm (#12545)

Build

[BUILD] Re-enable ccache by default (#12839)

CI

[ci] Fix docs deploy (#13570)
[ci] Split Jenkinsfile into platform-specific jobs (#13300)
[ci] Dis-allow any non-S3 URLs in CI (#13283)
[ci] Split out C++ unittests (#13335)
[CI] Separate the ci scripts into Github and Jenkins scripts (#13368)
[ci] Assert some tests are not skipped in the CI (#12915)
[ci] Ignore JUnit upload failures (#13142)
[ci] Lint for trailing newlines and spaces (#13058)
[ci] Template build steps (#12983)
[ci][docker] Allow usage of ECR images in PRs (#13590)
[ci][docker] Read docker image tags during CI runs (#13572)
[ci][wasm] Add package-lock.json to git (#13505)

CL

[ACL] Enable int8 data type in pooling operators (#13488)

CMSIS-NN

[CMSIS-NN] Support for int16 conv2d (#12950)
[CMSIS-NN] Support for int16 in fully connected layer (#13484)

DNNL

[AMP] refine AMP and the corresponding tests for bfloat16 (#12787)

Docker

[Docker]Refactor timezone script and NRF installation (#13342)

Docs

[docs] Fix empty code blocks in tutorials (#13188)

Ethos-N

[ETHOSN] Consolidate target string usage (#13159)
[ETHOSN] Throw error message when inference fails (#13022)
[ETHOSN] Inline non-compute-intensive partitions (#13092)
[ETHOSN] Transpose fully connected weights (#12970)
[ETHOSN] Support conversion of add/mul to requantize where possible (#12887)

Frontend

[TFLite] Enable int64 biases for int16 quantized operators (#12042)

Hexagon

[Hexagon] Add HVX quant conv2d implementation (#13256)
[Hexagon] Add test to show scheduling of resnet50 with async dma pipe… (#13352)
[Hexagon] Enable Hexagon User DMA bypass mode (#13381)
[Hexagon] Lint tests part 2 (#13271)
[Hexagon] Add pylint on tests (#13233)
[Hexagon] Add E2E test demonstrating how to apply blocked layout schedule to conv2d via metaschedule (#13180)
[Hexagon] Add a test to show how to use multi input async dma pipelin… (#13110)
[Hexagon]: Add upload function to hexagon session (#13161)
[Hexagon] Add support for instrumentation based profiling for Hexagon (#12971)
[Hexagon] Add power manager (#13162)
[Hexagon] Add scripts for e2e MetaSchedule tuning demonstration (#13135)
[Hexagon] Add feature to copy logcat to --hexagon-debug and add new --sysmon-profile option to run sysmon profiler during the test (#13107)
[Hexagon] Async DMA pipelining test suite (#13005)
[Hexagon] Enable multi input Async DMA; same queue / stage (#13037)
[Hexagon] Do not use target test fixture in Hexagon tests (#12981)
[Hexagon] 3-stage pipeline; multi queue async DMA for cache read / write (#12954)
[Hexagon] vrmpy tensorization for e2e compilation of int8 models (#12911)
[Hexagon] Support template-free meta schedule tuning (#12854)
[Hexagon] depth_to_space slice op (#12669)
[Hexagon] Make allocate_hexagon_array a hexagon contrib API (#13336)
[Hexagon] Add fix for vtcm allocation searches (#13197)
[MetaSchedule][Hexagon] Add postproc for verifying VTCM usage (#13538)
[Hexagon][QNN] Add TOPI strategies for qnn ops mul/tanh/subtract (#13416)
[Logging][Hexagon] Improve logging on Hexagon (#13072)
[Hexagon] [runtime] Per-thread hardware resource management (#13181)
[Hexagon] [runtime] Create objects to manage thread hardware resources (#13111)
[QNN][Hexagon] Disable QNN canonicalization pass (#12398)
[Hexagon] [runtime] Manage RPC and runtime buffers separately (#13028)
[Hexagon] [runtime] VTCM Allocator (#12947)
[TOPI][Hexagon] Add schedule and test for maxpool uint8 layout (#12826)
[TOPI][Hexagon] Implement quantize op for hexagon (#12820)
[Meta Schedule][XGBoost] Update the custom callback function of xgboost in meta schedule (#12141)
[TIR] [Hexagon] Add vdmpy intrinsic and transform_layout for tests (#13557)
[Hexagon] [runtime] Support VTCM alignments of 128 or 2k (#12999)
[HEXAGON][QHL] Clippling the inputs of HVX version of QHL Sigmoid operation (#12919)
[Hexagon] [runtime] Add user DMA to device API resource management (#12918)

LLVM

[LLVM] Emit fp16/fp32 builtins directly into target module (#12877)
[LLVM] Switch to using New Pass Manager (NPM) with LLVM 16+ (#13515)

MetaSchedule

[MetaSchedule] Make MultiLevelTiling apply condition customizable (#13535)
[MetaSchedule] Enhance Database Validation Script (#13459)
[MetaSchedule] Fix Dynamic Loop from AutoBinding (#13421)
[MetaSchedule] Support schedules with cache read in RewriteLayout (#13384)
[MetaSchedule] Improve inlining and VerifyGPUCode for quantized model workload (#13334)
[MetaSchedule] Add JSON Database Validation Scripts (#12948)
[MetaSchedule] Fix the order of applying AutoInline in ScheduleUsingAnchorTrace (#13329)
[MetaSchedule] Refactor ScheduleRule Attributes (#13195)
[MetaSchedule] Improve the script for TorchBench model tuning & benchmarking (#13255)
[MetaSchedule] Enable anchor-block tuning (#13206)
[MetaSchedule] Introduce a variant of ModuleEquality to enable ignoring NDArray raw data (#13091)
[MetaSchedule] Consolidate module hashing and equality testing (#13050)
[MetaSchedule] Support RewriteLayout postproc on AllocateConst (#12991)
[MetaSchedule] Tuning API cleanup & ergonomics (#12895)
[MetaSchedule] Fix XGBoost Import Issue (#12936)
[MetaSchedule] Add Script for TorchBench Model Tuning & Benchmarking (#12914)
[MetaSchedule] Restore num_threads parameter in tuning API (#13561)
[MetaSchedule] TorchBench tuning script: add option to disallow operators in sub graph (#13453)
[MetaSchedule] Fix segfault in gradient based scheduler (#13399)
[MetaSchedule] Add from-target Defaults for x86 VNNI Targets (#13383)
[MetaSchedule] Fix Task Hanging in EvolutionarySearch (#13246)
[MetaSchedule] Allow skipping exact NDArray rewrite in RemoveWeightLayoutRewriteBlock (#13052)
[MetaSchedule][UX] Support Interactive Performance Table Printing in Notebook (#13006)
[MetaSchedule][UX] User Interface for Jupyter Notebook (#12866)

microNPU

[microNPU] Upgrade Vela to v3.5.0 (#13394)
[microNPU] Fixed MergeConstants pass on striped networks (#13281)

microTVM

[microNPU] Upgrade Vela to v3.5.0 (#13394)
[microNPU] Fixed MergeConstants pass on striped networks (#13281)
[microTVM] Modernize Arm Cortex-M convolution schedules (#13242)
[microTVM] Improve code reuse in Corstone300 conv2d tests (#13051)
[microTVM] Add Cortex-M DSP schedules for optimal conv2d layouts (#12969)
[microTVM] Use default Project Options in template projects and add Makefile for Arduino template project (#12818)
[microTVM] Generalize depthwise_conv2d schedule (#12856)
[microTVM] add the option to open a saved micro project for debugging (#12495)
Added macro generation in MLF export (#12789)
[microTVM][Arduino]Add serial_number to project options and tests (#13518)
[microTVM][Zephyr] Add 'serial_number' option (#13377)
[microTVM][PyTorch][Tutorial]Adding a PyTorch tutorial for microTVM with CRT (#13324)

Misc

[CodegenC] Explicit forward function declarations (#13522)
[FQ2I] Support converting dense -> add to qnn.dense -> add -> requantize (#13578)
[Minor][Testing] Consolidate IRs into corresponding functions (#13339)
Add recursive on loop with marked kUnrolled (#13536)
Skip stride check if shape is 1 in IsContiguous (#13121)
[TEST] CPU feature detection for x86 and ARM dot product instructions (#12980)
[Node] Expose StructuralEqual/Hash handler implemenation...

Assets 5

17 Oct 17:44

AndrewZhaoLuo

v0.10.0

7b50b2d

Apache TVM v0.10.0

Introduction

The TVM community has worked since the v0.9 release to deliver the following new exciting improvments!

Metaschedule
- Software pipelining and padding for irregular shapes for auto tensorization
- Stabilized and polished user-interfaces (e.g. database changes, tune_relay)
- A new MLP-based cost model
TIR
- New schedule primitive for PadEinsum
- A new TIR node: DeclBuffer
- INT8 Intrinsics for TensorCores for CUDA!
microTVM
- Improved schedule primitives for ARM v8-m ISA

And many other general improvements to code quality, TVMScript, and more! Please visit the full listing of commits for a complete view: v0.9.0...v0.10.0rc0.

RFCs

These RFCs have been merged in apache/tvm-rfcs since the last release.

What's Changed

Please visit the full listing of commits for a complete view: v0.9.0...v0.10.0rc0.

Note that this list is not comprehensive of all PRs and discussions since v0.9. A non-truncated summary can be found here: #12979

TIR

#12720 - [TIR] Implement API for padded layout transformations
#12797 - [TIR] Construct the inverse in SuggestIndexMap
#12827 - [TIR] Support pattern matching argmax/argmin generated by TOPI
#12750 - [TIR, Schedule] Add schedule primitive PadEinsum
#11639 - [TIR][Meta-Schedule] Tuple-reduction scheduling support
#12515 - [TIR][Arith] Add more strict checking in imm construction and folding.
#12717 - [TIR, Schedule] Check consumer in-bound and covered in reverse_compute_inline
#12652 - [TIR] Handle axis_separators during FlattenBuffer
#12623 - [TIR] Expose MMA-related PTX builtins
#12607 - [TIR][Schedule] enhance compute_at and reverse_compute_at primitive to choose possible position
...

Assets 5

Releases: apache/tvm

Apache TVM v0.18.0

Introduction

Community

RFCs

BYOC

BugFix

CI

Disco

Dlight

Docker

Docs

Frontend

Apache TVM v0.17.0

Introduction

Community

RFCs

AOT

Adreno

BYOC

BugFix

CI

CRT

Disco

Dlight

Docs

Frontend

Hexagon

LLVM

MetaSchedule

Metal

OpenCL & CLML

ROCm

Relax

Apache TVM v0.16.0

Introduction

Community

RFCs

Arith

BYOC

BugFix

CI

Docker

Disco

Dlight

Docs

Frontend

Apache TVM v0.15.0

Introduction

Community

RFCs

Adreno

Arith

ArmComputeLibrary

Metal

cuda & cutlass & tensorrt

micoNPU

Runtime

BugFix

CI

Docs

Frontend & Relay

TOPI

TIR

TVMScript

Misc

Apache TVM v0.14.0

Introduction

Community

RFC

AOT

Adreno

Arith

ArmComputeLibrary

BugFix

CI

CMSIS-NN

Docker

Docs

Frontend