Skip to content

v0.52.0

Latest
Latest
Compare
Choose a tag to compare
@github-actions github-actions released this 25 Sep 16:13
· 155 commits to main since this release
v0.52.0
5448c47
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

Note

This is a verified, real release, however the release notes are under construction. Thank you for understanding.

Note

If you are installing from a release, please refer to the README, INSTALLATION instructions, and any other documentation packaged with the release, not on the main branch. There may be differences between the latest main and the previous release.

The changelog will now follow, showing the changes from last release.

This release was generated by the CI workflow https://github.com/tenstorrent/tt-metal/actions/runs/11036234439

📦 Uncategorized

  • #12323: delete ctor of AllGatherFusedOpSignaler
  • #0: Revert "#0: Update to gcc-12.x (#12332)"
  • #12448: Update 1d matmul sweep test to use CoreRangeSet for core range parameters
  • #0: [skip ci] Fix demo invocation in Llama README
  • #0: Update device creations functions to use num_command_queues instead of num_hw_cqs to match mesh_device creation functions
  • #12273: Move full wheel build on GitHub runners and 22.04 to scheduled job and fix related
  • Update perf and latest features for llm models (Sept 11)
  • #12532: Change sweep new vector checking to use the serialized vector…
  • #12451: add negative ends support for slice with list splicing format
  • fix llama t3k demo invoke in CI
  • Yugao/doc
  • #10855: Add single-device perf measurements to sweep infra
  • #9340: Add optional output tensor support for assign
  • #0: Add ccl multichip stack overview
  • #12371: Migrate moreh_getitem operation from tt_eager to ttnn
  • #11651: Remove type_caster
  • #12375: Add qid and optional tensor output to ttnn.gelu_bw
  • #8865: Optimized ttnn.bcast dispatch times
  • #12196: Use split readers wherever possible in UNet Shallow
  • Replace exact output match with tight pcc check in post-commit
  • #12148: Add queue_id and optional output tensors to ttnn.mul_bw
  • Fix start_pos in get_rot_mat() in llama galaxy model
  • Yieldthought/llama31 8b/ttembed
  • #8865: Fix non working ops in dispatch profiling infra
  • #0: Remove myself from tt_lib/csrc codeowners
  • Update workload theoretical ethernet numbers
  • #12524: Update fmt and unify logging API
  • #0: Update fmt and unify logging API
  • #11133: Improve various things about the wheel, including removal of patchelf and linking runtime assets to cwd
  • Support for initializing with 0s for SUM reduction WHB0
  • #12376: Support for non-32 Height in Width Sharded Conv2d
  • #0: Optimize context switch decision
  • #0: Correct #!/bin script headers
  • #12538: Separate out wheel tests from build so that other wheel-dependent jobs aren't blocked by the wheel smoke tests
  • #0: Create Blackhole Bring-Up Programming Guide
  • #12552: Fix indentation pybind files
  • #0: Add FD nightly single-card pipeline to data pipeline
  • #0: [skip_ci] Updating BH bring-up programming guide
  • Update owner of T3K ttnn unit tests
  • #0: change default reduce scatter num buffers per channel to 2
  • #12436: port moreh_sum from tt_dnn to ttnn
  • #12026: add permute sweep tests for trace
  • #12514: port moreh_mean and moreh_mean_backward from tt_dnn to ttnn
  • #12207: Port moreh_dot to ttnn
  • #12259: Move moreh dot backward
  • #12164: Add queue_id and optional output tensors to backward ops
  • #12439: Migrate moreh_nll_loss_bwd operations (reduced and unreduced) from tt_eager to ttnn
  • #12578: Update Mixtral t/s/u in README
  • #12373: Add queue_id and optional output tensors to rsqrt_bw op
  • remove todos from doc
  • add code language formatting CclDeveloperGuide.md
  • #0: Update multi-chip Resnet perf numbers after dispatch optimizations
  • #0: Remove unused _init, _fini
  • #0: remove unused variable
  • Contiguous pages support in Reduce Scatter read/write
  • #12628: Resolve arithmetic error in test_multi_cq_multi_dev causing T3K multi-CQ tests to fail
  • #12619: Update matmul sweep timeout and core range set usage
  • Run on custom dispatch commands on in-service runners only
  • #12544: support wide channels (> 256) in maxpool
  • #12605: Implement recommendations for Llama readme
  • #0: Point UMD back to main instead of metal-main
  • #0: ViT Trace+2CQ implementation
  • #0: Add BH to custom test dispatch workflow
  • Update ViT on GS perf
  • LLama selfout specific optimizations for fused all_gather_matmul op
  • #12520: Adding noc_async_writes_flushed between mcast writes and mcast semaphore sets for BH
  • #11144: Upgrade pip version to 21.2.4 to get around 22.04 import error
  • Remove duplicate from sfpu_split_includes.h
  • #12250: port moreh_matmul from tt_dnn to ttnn
  • #12297: Add queue_id and optional output tensors to add_bw op
  • #12392: Use shallow convolution in upblock3 of UNet Shallow
  • #0: Make CoreRangeSet thread safe
  • mm_sfence->tt_driver_atomics::sfence();
  • [New Op] Added dropout unary op
  • #12392: Shallov conv unet uts
  • Pkeller/memmap profiler
  • #0: Set WH_ARCH_YAML only if we have a wormhole machine
  • All gather expose params
  • Generalize nlp create head decode
  • #0: Remove CCL stalls, since Fabric VC support is merged
  • #0: Remove incorrect norelax option
  • #12668: SWOC bugfix
  • Fix start pos in get_rot_mat
  • #0: Remove unused CRT_START label
  • #12701: Split nightly tests into specific models for better reading
  • #0: Relax host bound tg threshold for Resnet
  • Rename tt::tt_metal::Shape to LegacyShape to not conflict with TTNN
  • #12374: Add optional output tensor support for ttnn.full_like
  • YoloV4 pipeline update
  • #12425: Add queue_id and optional output tensors to zeros_like
  • #12497: ttnn.empty to use create_device_tensor
  • #12266: Cleanup ternary backward
  • #0: Use absolute addressing in startup
  • #12595: Run profiler gather after every sweep test regardless of status
  • #12730: bert slice support unit tests
  • Reduce scatter perf sweep
  • #12778: Speed up sweeps parameter generation
  • #0: DPrint bugfix for which dispatch cores are included in 'all'
  • #12730: bert slice support unit tests correction
  • #5783: Remove watcher dependency on generated headers
  • #0: Update GS Resnet perf thresholds. Seeing large variation in CI
  • Fix issue w/ CBs getting allocated on ETH cores
  • #12802: add tracy option to build_metal.sh
  • #12748: Cleanup clamp_bw op
  • #12224: Add optional output tensor support for lt_bw
  • #12387: Workaround to_layout for height sharded tensor
  • #12196: Use split_reader and act db
  • #12508: Skip failing test in CI
  • #11512: Add frac, ceil and trunc sweeps
  • #0: Don't overwrite CMake flags in build_metal.sh
  • Add subtract, subalpha and rsub sweeps, interleaved
  • Llama tg/sharded ccls
  • Update peak dram speed to 288GB/s
  • #11169: Watcher to report if eth link retraining occurred during teardown
  • #0: adding jaykru-tt as codeowner for data_movement operations
  • Mamba CI hanging on Untilize fix
  • #12749: Update Test files
  • #12799: Add handling for pytest errors, especially those at the beginning, and expose their messages
  • #12529: Update comment of dataflow api for mcast loopback functions
  • Fix failure in llama perf on CI
  • fix typo - mention higher level multichip API above CCL ops
  • Add Mamba unit tests to post-commit test suite
  • #12529: Add check for in0_mcast_num_cores=1 for noc_async_write_multicast_loopback_src
  • #0: Change all ops which support page_table to enable non-log2 shapes
  • #12198: Add 2CQ and trace support for UNet Shallow
  • Add supports/examples for placing Reads and Writes on CQ1
  • #9370: Workaround: replace WRCFG with RMWCIB instructions in reduce_revert_delta
  • Remove UNet from landing page
  • #12750: Replace zeros_like with empty_like in backward ops
  • #12840: Add more handling more multiple attempts by restricting the space of github_job_ids we're looking to only the ones in the workflow run attempt in question
  • #12729: add row-major split for BERT
  • #12764: Cleanup abs_bw, threshold_bw
  • #11919: Enable fast dispatch build-and-unit-tests
  • #12770: Reorganize all gather
  • Mesh Virtualization
  • #8865: Add more ops to dispatch profile infra
  • Sin ,cos, relu, gelu and logical_or_ new infrastructure sweeps
  • #10936: Enable llama tg unit test
  • Add support for dim=3 in ttnn.argmax
  • #9288: Add ttnn support for distilbert model
  • #0: Handling Absence of Prefill in Mistral Prefill Demo
  • #0: Update Mamba demo outputs
  • Llama prefill changes to enable vLLM
  • #12874: Skip flaky prefill single card perf test for now
  • #12877: Cache pip dependencies for data collection (infra) to save some time
  • bilinear support for upsample.
  • Add clamp, ceil, cbrt and floor sweeps, interleaved
  • #12557: bias shape was wrong, and need to create pure torch tensor
  • #12654: ttnn_tutorials resnet block document update
  • Update TG llama3_70b README.md
  • #12892: Add None for sweeps device perf on device execption
  • Update README.md
  • Update RN50 GS README.md
  • Update README.md
  • Add Unsqueeze and more support for squeeze
  • #10016: jit_build: link substitutes, tdma_xmov, noc
  • #0: Update tg/tgg Resnet READMEs to be in line with the others
  • #0: upsample fix for undefined behavior on multi-devices run.
  • #12912: Update CONTRIBUTING.md
  • LLK Test Coverage - MathFid and DestAcc in reduce API
  • #12615: Add queue_id output tensor to slice op, concat_bw
  • #12829: Cleanup softplus_bw, hardtanh_bw, prod_bw
  • Flash Decode GQA (and MQA) Improvements (Round 1)
  • #12435: Add queue_id and optional output tensors to div_bw op
  • #12758: Add queue_id and optional output tensors to div and trunc op
  • Add more sweeps, reorganize sweeps folders
  • #12885: Add initial unit tests for infra, specifically for data collection
  • #12782: Change all sweep framework infra to use loguru
  • #0: Conv act split reader speed up
  • Distributed Sharded Layernorm/RMSNorm
  • n_heads> 1 and share_cache support for paged update cache
  • #12658: Update sweeps export to sqlite script
  • #12946: Fixed TGG mapping to match cluster_desc.yaml
  • #12527: refactor slice
  • Fix squeeze Dim == 0 with padding
  • #12909: Skip users in FlashDecode based on index
  • #12954: pip install only build in wheel build since that's all we should need
  • #0: Bugfix for launch message setting on watcher hang for Tensix
  • New sweeps - Add exp, exp2, tanh sweeps
  • Reduce padding on UNet Shallow input tensor
  • #0: Direct build jobs for RelWithDebInfo onto in-service runners
  • #0: Fix mesh_device grid specification for tgg resnet tests after #12479 was merged
  • #12750: Replace zeros_like with empty_like in backward ops
  • #0: Simplify erisc entry/exit
  • Don't install dependencies on self-hosted builders
  • [skip ci] Add the programming examples list to the landing READme
  • [skip ci] #0: Prog Examples edits
  • [skip ci] #0: Prog Examples readme
  • #12355: Support vector of optional tensor and example
  • #12867: Cleanup 9 Unary Backward ops
  • #12795: Move numpy functions.hpp
  • #0: Shard and Pad programming examples
  • [skip ci] #0: Prog examples edits
  • Update README.md with unet perf
  • [skip ci] Update README.md
  • [skip ci] ViT TTNN Tech Report
  • [skip ci] Update README.md (ViT in TT-NN)
Assets 9
Loading