Skip to content

[Lang] Reject non-positive arrive_count in alloc_barrier and alloc_cluster_barrier - #3112

Merged
LeiWang1999 merged 1 commit into
tile-ai:mainfrom
yurekami:fix-alloc-barrier-validate
Aug 30, 2026
Merged

[Lang] Reject non-positive arrive_count in alloc_barrier and alloc_cluster_barrier#3112
LeiWang1999 merged 1 commit into
tile-ai:mainfrom
yurekami:fix-alloc-barrier-validate

Conversation

@yurekami

Copy link
Copy Markdown
Contributor

Fixes #3030.

alloc_barrier and alloc_cluster_barrier forwarded any integer arrive count straight into the barrier_init attribute with no positivity check, so T.alloc_barrier(0) (and negatives) compiled cleanly all the way to emitted CUDA. An mbarrier arrive count of 0 has no defined meaning — it must be at least 1 — and on Hopper bar[0].init(0) trips the CUTLASS assert at runtime; a negative count is worse, since the assert only checks != 0, so e.g. -5 slips through as a garbage unsigned value (as documented in the issue).

Both functions now reject non-positive counts at trace time with a clear ValueError naming the offending value, before anything reaches a device pass or codegen. The check runs on the raw argument (int or list), so alloc_barrier([128, 0]) is caught too.

Test: test_alloc_barrier_rejects_non_positive_arrive_count in testing/python/language/test_tilelang_language_alloc.py asserts the raise for 0, -5, and [128, 0], and that a valid count still traces. This part is CPU-only (frontend trace, no compile), matching the arch-independence noted in the issue.

@coderabbitai

coderabbitai Bot commented Aug 29, 2026

Copy link
Copy Markdown
Contributor

Important

Review skipped

Too many files!

This PR contains 1261 files, which is 961 over the limit of 300.

To get a review, reduce the PR to 300 files or fewer by splitting it into smaller PRs or changing its base branch.

Usage-priced reviews support at most 300 files.

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro Plus

Run ID: e61fa245-45a8-4b85-aca6-450ce36a0b2b

📥 Commits

Reviewing files that changed from the base of the PR and between 1889fd9 and 3981b14.

⛔ Files ignored due to path filters (3)
  • docs/_static/img/lower_trace_html.png is excluded by !**/*.png
  • docs/_static/img/pass_diff_html.png is excluded by !**/*.png
  • examples/iket/assets/iket_perfetto_all_features.png is excluded by !**/*.png
📒 Files selected for processing (1261)
  • .agents/skills/tilelang-backend/SKILL.md
  • .agents/skills/tilelang-backend/agents/openai.yaml
  • .agents/skills/tilelang-backend/references/integration-checklist.md
  • .agents/skills/tilelang-build/SKILL.md
  • .agents/skills/tilelang-cpp-style/SKILL.md
  • .agents/skills/tilelang-layout/SKILL.md
  • .agents/skills/tilelang-layout/agents/openai.yaml
  • .agents/skills/tilelang-semantic/SKILL.md
  • .agents/skills/tilelang-semantic/agents/openai.yaml
  • .agents/skills/tilelang-semantic/references/loop-rules.md
  • .agents/skills/tilelang-semantic/references/memory-concurrency.md
  • .agents/skills/tilelang-semantic/references/operations-layout.md
  • .agents/skills/tilelang-semantic/scripts/scan_loop_nesting.py
  • .agents/skills/tilelang-simplification/SKILL.md
  • .agents/skills/tilelang-simplification/agents/openai.yaml
  • .agents/skills/tilelang-submit-pr/SKILL.md
  • .agents/skills/tilelang-tvm-ir/SKILL.md
  • .coderabbit.yaml
  • .github/workflows/ci.yml
  • .github/workflows/dist.yml
  • .github/workflows/pr-regression-test-bot.yml
  • .github/workflows/publish-docs.yml
  • .gitignore
  • .gitmodules
  • .pre-commit-config.yaml
  • 3rdparty/hip-headers/include/hip/amd_detail/amd_channel_descriptor.h
  • 3rdparty/hip-headers/include/hip/amd_detail/amd_device_functions.h
  • 3rdparty/hip-headers/include/hip/amd_detail/amd_hip_atomic.h
  • 3rdparty/hip-headers/include/hip/amd_detail/amd_hip_common.h
  • 3rdparty/hip-headers/include/hip/amd_detail/amd_hip_gl_interop.h
  • 3rdparty/hip-headers/include/hip/amd_detail/amd_hip_runtime.h
  • 3rdparty/hip-headers/include/hip/amd_detail/amd_hip_runtime_pt_api.h
  • 3rdparty/hip-headers/include/hip/amd_detail/amd_hip_unsafe_atomics.h
  • 3rdparty/hip-headers/include/hip/amd_detail/amd_hip_vector_types.h
  • 3rdparty/hip-headers/include/hip/amd_detail/amd_math_functions.h
  • 3rdparty/hip-headers/include/hip/amd_detail/amd_surface_functions.h
  • 3rdparty/hip-headers/include/hip/amd_detail/amd_warp_functions.h
  • 3rdparty/hip-headers/include/hip/amd_detail/amd_warp_sync_functions.h
  • 3rdparty/hip-headers/include/hip/amd_detail/device_library_decls.h
  • 3rdparty/hip-headers/include/hip/amd_detail/hip_api_trace.hpp
  • 3rdparty/hip-headers/include/hip/amd_detail/hip_assert.h
  • 3rdparty/hip-headers/include/hip/amd_detail/hip_fp16_math_fwd.h
  • 3rdparty/hip-headers/include/hip/amd_detail/hip_ldg.h
  • 3rdparty/hip-headers/include/hip/amd_detail/hip_prof_str.h
  • 3rdparty/hip-headers/include/hip/amd_detail/hip_runtime_prof.h
  • 3rdparty/hip-headers/include/hip/amd_detail/host_defines.h
  • 3rdparty/hip-headers/include/hip/amd_detail/math_fwd.h
  • 3rdparty/hip-headers/include/hip/amd_detail/ockl_image.h
  • 3rdparty/hip-headers/include/hip/amd_detail/texture_fetch_functions.h
  • 3rdparty/hip-headers/include/hip/amd_detail/texture_indirect_functions.h
  • 3rdparty/hip-headers/include/hip/channel_descriptor.h
  • 3rdparty/hip-headers/include/hip/driver_types.h
  • 3rdparty/hip-headers/include/hip/hip_common.h
  • 3rdparty/hip-headers/include/hip/hip_deprecated.h
  • 3rdparty/hip-headers/include/hip/hip_runtime.h
  • 3rdparty/hip-headers/include/hip/hip_runtime_api.h
  • 3rdparty/hip-headers/include/hip/hip_texture_types.h
  • 3rdparty/hip-headers/include/hip/hip_vector_types.h
  • 3rdparty/hip-headers/include/hip/hip_version.h
  • 3rdparty/hip-headers/include/hip/library_types.h
  • 3rdparty/hip-headers/include/hip/linker_types.h
  • 3rdparty/hip-headers/include/hip/surface_types.h
  • 3rdparty/hip-headers/include/hip/texture_types.h
  • 3rdparty/hip-headers/include/hsa/hsa.h
  • 3rdparty/tvm
  • CMakeLists.txt
  • CONTRIBUTING.md
  • README.md
  • VERSION
  • benchmark/compile_speed/README.md
  • benchmark/compile_speed/benchmark_compile_speed.py
  • benchmark/compile_speed/kernel_zoo.py
  • benchmark/matmul/benchmark_matmul.py
  • benchmark/matmul/benchmark_matmul_sp.py
  • benchmark/matmul/benchmark_matmul_sp_compress.py
  • benchmark/matmul_metal/benchmark_matmul_metal.py
  • cmake/FindPipCUDAToolkit.cmake
  • cmake/ccache_strip_pep517.py
  • cmake/find_pip_cuda.py
  • cmake/generate_windows_import_lib.py
  • cmake/load_tvm.cmake
  • cmake/pypi-z3/FindZ3.cmake
  • docs/compiler_internals/inject_fence_proxy.md
  • docs/compiler_internals/metal_tilelang_development.md
  • docs/deeplearning_operators/matmul.md
  • docs/deeplearning_operators/matmul_sparse.md
  • docs/developer_guide/cpp_style.md
  • docs/get_started/Installation.md
  • docs/get_started/targets.md
  • docs/index.md
  • docs/programming_guides/autotuning.md
  • docs/programming_guides/cluster_tma.md
  • docs/programming_guides/control_flow.md
  • docs/programming_guides/instructions.md
  • docs/programming_guides/overview.md
  • docs/programming_guides/software_pipeline.md
  • docs/runtime_internals/stubs.md
  • docs/spelling_wordlist.txt
  • docs/tools/analyzer.md
  • docs/tools/autodd.md
  • docs/tools/compile_only.md
  • docs/tools/iket.md
  • docs/tools/index.md
  • docs/tools/layout_visualization.md
  • docs/tools/lower_trace.md
  • docs/tools/pass_diff.md
  • docs/tutorials/debug_tools_for_tilelang.md
  • examples/analyze/README.md
  • examples/analyze/example_conv_analyze.py
  • examples/analyze/example_gemm_analyze.py
  • examples/autodd/README.md
  • examples/autodd/tilelang_buggy.py
  • examples/autodd/tilelang_minimized_expected.py
  • examples/aws/flash_attention.py
  • examples/aws/gemm.py
  • examples/aws/test_example_aws.py
  • examples/bitnet-1.58b/kernel_benchmark/tilelang_bitnet_158_int8xint2_prefill.py
  • examples/bitnet-1.58b/requirements.txt
  • examples/block_causal_attention/block_causal_attention.py
  • examples/block_causal_attention/block_causal_attention_varlen.py
  • examples/block_causal_attention/test_block_causal_attention.py
  • examples/blockscaled_gemm_sm100/gemm_mxfp8_blockscaled_1d1d.py
  • examples/blockscaled_gemm_sm100/grouped_gemm_mxfp8_blockscaled_1d1d.py
  • examples/blockscaled_gemm_sm100/mxfp8_illustrated.md
  • examples/blocksparse_attention/test_example_blocksparse_attention.py
  • examples/blocksparse_gemm/example_blocksparse_gemm.py
  • examples/cast/example_group_per_split_token_cast_to_fp8.py
  • examples/cast/example_per_token_cast_to_fp8.py
  • examples/conftest.py
  • examples/convolution/example_convolution.py
  • examples/convolution/example_convolution_autotune.py
  • examples/deepseek_deepgemm/example_deepgemm_fp8_2xAcc.py
  • examples/deepseek_mhc/example_mhc_bwd.py
  • examples/deepseek_mhc/example_mhc_pre.py
  • examples/deepseek_mla/example_mla_decode_ws.py
  • examples/deepseek_nsa/benchmark/benchmark_nsa_fwd.py
  • examples/deepseek_nsa/example_tilelang_nsa_bwd.py
  • examples/deepseek_nsa/example_tilelang_nsa_decode.py
  • examples/deepseek_nsa/example_tilelang_nsa_fwd.py
  • examples/deepseek_nsa/example_tilelang_nsa_fwd_varlen.py
  • examples/deepseek_v32/README.md
  • examples/deepseek_v32/fp8_lighting_indexer.py
  • examples/deepseek_v32/inference/README.md
  • examples/deepseek_v32/inference/kernel.py
  • examples/deepseek_v32/sparse_mla_bwd.py
  • examples/deepseek_v32/sparse_mla_fwd.py
  • examples/deepseek_v32/sparse_mla_fwd_pipelined.py
  • examples/deepseek_v32/sparse_mla_fwd_seesaw.py
  • examples/deepseek_v32/test_tilelang_example_deepseek_v32.py
  • examples/deepseek_v32/topk_selector.py
  • examples/deepseek_v4/act_quant.py
  • examples/deepseek_v4/fp8_fp4_gemm_1d1d_sm100.py
  • examples/deepseek_v4/sparse_attn_fwd_sm90.py
  • examples/deepseek_v4/test_tilelang_example_deepseek_v4.py
  • examples/dequantize_gemm/dequantize_utils.py
  • examples/dequantize_gemm/example_dequant_gemm_bf16_fp4_hopper.py
  • examples/dequantize_gemm/example_dequant_gemm_bf16_mxfp4_cdna4.py
  • examples/dequantize_gemm/example_dequant_gemm_bf16_mxfp4_hopper.py
  • examples/dequantize_gemm/example_dequant_gemm_fine_grained.py
  • examples/dequantize_gemm/example_dequant_gemm_fp4_hopper.py
  • examples/dequantize_gemm/example_dequant_gemm_w4a8.py
  • examples/dequantize_gemm/example_dequant_gemv_fp16xint4.py
  • examples/dequantize_gemm/quantize/__init__.py
  • examples/dequantize_gemm/quantize/lop3.py
  • examples/dequantize_gemm/quantize/mxfp.py
  • examples/dequantize_gemm/quantize/nvfp4.py
  • examples/dequantize_gemm/quantize/quantization.py
  • examples/dequantize_gemm/quantize/utils.py
  • examples/dsa_sparse_finetune/indexer_bwd.py
  • examples/dsa_sparse_finetune/sparse_mla_bwd.py
  • examples/dsa_sparse_finetune/sparse_mla_fwd.py
  • examples/dsa_sparse_finetune/sparse_mla_topk_reducesum.py
  • examples/dynamic_shape/example_dynamic.py
  • examples/eager_jit/eagerjit.en.ipynb
  • examples/eager_jit/eagerjit.zh.ipynb
  • examples/elementwise/example_elementwise_add.py
  • examples/flash_attention/README.md
  • examples/flash_attention/example_gqa_bwd_tma_reduce_varlen.py
  • examples/flash_attention_sm100/gqa_bwd_bshd.py
  • examples/flash_attention_sm100/gqa_fwd_bshd.py
  • examples/flash_attention_sm100/mha_fwd_bshd.py
  • examples/flash_decoding/example_mha_inference.py
  • examples/fusedmoe/example_fusedmoe_tilelang.py
  • examples/gdn/README.md
  • examples/gdn/example_chunk_delta_bwd.py
  • examples/gdn/example_chunk_o_bwd.py
  • examples/gdn/test_example_gdn_compilation.py
  • examples/gemm/README.md
  • examples/gemm/example_gemm.py
  • examples/gemm/example_gemm_advanced_autotune.py
  • examples/gemm/example_gemm_autotune.py
  • examples/gemm/example_gemm_autotune_early_stop.py
  • examples/gemm/example_gemm_autotune_pass_configs.py
  • examples/gemm/example_gemm_intrinsics.py
  • examples/gemm/example_gemm_persistent.py
  • examples/gemm/regression_example_gemm.py
  • examples/gemm/test_example_gemm.py
  • examples/gemm_fp8/example_tilelang_gemm_amd.py
  • examples/gemm_fp8/example_tilelang_gemm_amd_fp8_preshuffle.py
  • examples/gemm_fp8/example_tilelang_gemm_fp8.py
  • examples/gemm_fp8/example_tilelang_gemm_fp8_2xAcc.py
  • examples/gemm_fp8/example_tilelang_gemm_fp8_sm100.py
  • examples/gemm_fp8/regression_example_gemm_fp8.py
  • examples/gemm_fp8/test_example_gemm_fp8.py
  • examples/gemm_sm120/sm120_nvfp4_blockscaled_gemm.py
  • examples/gemm_sp/example_gemm_sp.py
  • examples/gemm_sp/sparse_utils.py
  • examples/gemm_sp/test_example_gemm_sp.py
  • examples/gemm_splitk/example_tilelang_gemm_splitk.py
  • examples/gemm_splitk/example_tilelang_gemm_splitk_vectorize_atomicadd.py
  • examples/gemm_streamk/example_tilelang_gemm_streamk.py
  • examples/gemm_tcgen05/README.md
  • examples/gemm_tcgen05/gemm_mma.py
  • examples/gemm_tcgen05/gemm_tcgen5mma.py
  • examples/gemm_tcgen05/gemm_tcgen5mma_ws.py
  • examples/gemm_tcgen05/gemm_tcgen5mma_ws_clc.py
  • examples/gemm_tcgen05/gemm_tcgen5mma_ws_persistent.py
  • examples/gemm_tcgen05/gemm_tcgen5mma_ws_persistent_streamk.py
  • examples/gemv/example_gemv.py
  • examples/grouped_gemm/example_grouped_gemm_bwd.py
  • examples/grouped_gemm/example_grouped_gemm_fwd.py
  • examples/hadamard_transform/example_hadamard.py
  • examples/iket/README.md
  • examples/iket/all_features.py
  • examples/iket/minimal.py
  • examples/iket/payload_minimal.py
  • examples/linear_attention/example_mamba_chunk_scan.py
  • examples/linear_attention/example_mamba_chunk_state.py
  • examples/minference/example_vertical_slash_sparse_attn.py
  • examples/norm/layernorm.py
  • examples/norm/rms_norm.py
  • examples/norm/test_rms_norm.py
  • examples/online_softmax/online_softmax.py
  • examples/plot_layout/README.md
  • examples/plot_layout/fragment_mfma_load_a.py
  • examples/plot_layout/fragment_mma_load_a.py
  • examples/quickstart.py
  • examples/rand/rand_uint.py
  • examples/topk/example_topk.py
  • examples/visual_layout_inference/visual_layout_inference.py
  • examples/warp_specialize/example_warp_specialize_flashmla.py
  • examples/warp_specialize/example_warp_specialize_gemm_barrierpipe_stage2.py
  • examples/warp_specialize/example_warp_specialize_gemm_copy_0_gemm_1.py
  • examples/warp_specialize/example_warp_specialize_gemm_copy_1_gemm_0.py
  • examples/warp_specialize/example_warp_specialize_gemm_copy_gemm_0_1.py
  • examples/warp_specialize/example_warp_specialize_gemm_softpipe_stage2.py
  • maint/gemm/correctness_evaluation.py
  • maint/gemm/correctness_evaluation_sm70.py
  • maint/gemm/correctness_evaluation_tcgen05.py
  • maint/gemm/correctness_evaluation_tcgen05_2cta.py
  • maint/gemm/correctness_evaluation_tcgen05_fp4_unpacked.py
  • maint/gemm/gemm_sm120/benchmark_sm120_nvfp4_blockscaled_gemm.py
  • maint/gemm/gemm_sm120/correctness_evaluation_nvf4_vs_cutlass.py
  • maint/gemm/gemm_sm120/cutlass_nvf4_ref.cu
  • maint/gemm/gemm_sm120/tilelang_nvfp4_quantizer.py
  • maint/host_checks/cutedsl_im2col_smoke.py
  • maint/host_checks/cutedsl_launcher_overhead.py
  • maint/host_checks/cutedsl_tma_launcher_overhead.py
  • maint/layout_inference/README.md
  • maint/layout_inference/cases/broadcast_read.py
  • maint/layout_inference/cases/elementwise_copy.py
  • maint/layout_inference/cases/fp8_copy.py
  • maint/layout_inference/cases/mixed_dtype_chain.py
  • maint/layout_inference/cases/offset_region_copy.py
  • maint/layout_inference/cases/reduce_broadcast.py
  • maint/layout_inference/cases/shared_staging.py
  • maint/layout_inference/cases/transposed_store.py
  • maint/layout_inference/common.py
  • maint/layout_inference/cute_model.py
  • maint/layout_inference/expected/broadcast_read.json
  • maint/layout_inference/expected/elementwise_copy.json
  • maint/layout_inference/expected/fp8_copy.json
  • maint/layout_inference/expected/mixed_dtype_chain.json
  • maint/layout_inference/expected/offset_region_copy.json
  • maint/layout_inference/expected/reduce_broadcast.json
  • maint/layout_inference/expected/shared_staging.json
  • maint/layout_inference/expected/transposed_store.json
  • maint/layout_inference/oracle.py
  • maint/layout_inference/run.py
  • maint/precision/compare_ops.py
  • maint/scripts/audit_cpp_api_style.py
  • maint/scripts/compare_perf_regression.py
  • maint/scripts/docker_local_distribute.sh
  • maint/scripts/docker_pypi_distribute.sh
  • maint/scripts/regression_all.py
  • maint/scripts/run_current_regression.py
  • maint/scripts/run_perf_regression.sh
  • pyproject.toml
  • requirements-dev.txt
  • requirements-test-cuda.txt
  • requirements.txt
  • src/backend/common/codegen/codegen_c_host.cc
  • src/backend/common/codegen/codegen_c_host.h
  • src/backend/common/codegen/codegen_c_line_directives.h
  • src/backend/common/codegen/codegen_utils.cc
  • src/backend/common/codegen/codegen_utils.h
  • src/backend/common/op/atomic_reduce.h
  • src/backend/common/op/fill.h
  • src/backend/common/op/finalize_reducer.h
  • src/backend/common/op/reduce.h
  • src/backend/common/op/scan.h
  • src/backend/common/op/transpose.h
  • src/backend/common/target_utils.cc
  • src/backend/common/target_utils.h
  • src/config.h
  • src/cpu/CMakeLists.txt
  • src/cpu/codegen/codegen_c.cc
  • src/cpu/codegen/codegen_c.h
  • src/cpu/codegen/rt_mod_c.cc
  • src/cpu/op/atomic_add.cc
  • src/cpu/op/atomic_reduce.cc
  • src/cpu/op/atomic_rmw.h
  • src/cpu/op/copy.cc
  • src/cpu/op/fill.cc
  • src/cpu/op/gemm.cc
  • src/cpu/op/reduce.cc
  • src/cpu/op/transpose.cc
  • src/cpu/target_utils.cc
  • src/cpu/target_utils.h
  • src/cpu/transform/lower_cpu_atomics.cc
  • src/cuda/CMakeLists.txt
  • src/cuda/codegen/codegen_cuda.cc
  • src/cuda/codegen/codegen_cuda.h
  • src/cuda/codegen/codegen_cutedsl.cc
  • src/cuda/codegen/codegen_cutedsl.h
  • src/cuda/codegen/codegen_py.cc
  • src/cuda/codegen/codegen_py.h
  • src/cuda/codegen/intrin_rule_cuda.cc
  • src/cuda/codegen/ptx.cc
  • src/cuda/codegen/ptx.h
  • src/cuda/codegen/rt_mod_cuda.cc
  • src/cuda/codegen/rt_mod_cutedsl.cc
  • src/cuda/op/atomic_add.cc
  • src/cuda/op/atomic_reduce.cc
  • src/cuda/op/builtin.cc
  • src/cuda/op/builtin.h
  • src/cuda/op/copy.cc
  • src/cuda/op/copy.h
  • src/cuda/op/copy_analysis.cc
  • src/cuda/op/fill.cc
  • src/cuda/op/finalize_reducer.cc
  • src/cuda/op/gemm.cc
  • src/cuda/op/gemm_sp.cc
  • src/cuda/op/reduce.cc
  • src/cuda/op/scan.cc
  • src/cuda/op/tma_layout.cc
  • src/cuda/op/tma_layout.h
  • src/cuda/op/transpose.cc
  • src/cuda/runtime.cc
  • src/cuda/runtime.h
  • src/cuda/stubs/cuda.cc
  • src/cuda/stubs/cuda.h
  • src/cuda/stubs/cudart.cc
  • src/cuda/stubs/dynlib.h
  • src/cuda/stubs/nvrtc.cc
  • src/cuda/stubs/vendor/cuda.h
  • src/cuda/target_utils.cc
  • src/cuda/target_utils.h
  • src/cuda/transform/annotate_device_bound_tma_copies.cc
  • src/cuda/transform/annotate_warp_group_reg_alloc.cc
  • src/cuda/transform/fuse_mbarrier_arrive_expect_tx.cc
  • src/cuda/transform/inject_fence_proxy.cc
  • src/cuda/transform/inject_tcgen05_fence.cc
  • src/cuda/transform/lower_blackwell_2sm.cc
  • src/cuda/transform/lower_hopper_intrin.cc
  • src/cuda/transform/lower_l2_persistent_annotation.cc
  • src/cuda/transform/lower_ldg_stg.cc
  • src/cuda/transform/lower_pdl.cc
  • src/cuda/transform/lower_shared_barrier.cc
  • src/cuda/transform/lower_shared_tmem.cc
  • src/cuda/transform/materialize_ws_schedule.cc
  • src/cuda/transform/multi_version_buffer_rewriter.cc
  • src/cuda/transform/multi_version_buffer_rewriter.h
  • src/cuda/transform/persist_threadblock.cc
  • src/cuda/transform/producer_consumer_ws.cc
  • src/cuda/transform/ptx_async_copy_injector.cc
  • src/cuda/transform/ptx_async_copy_injector.h
  • src/ir.cc
  • src/layout/cute_layout.cc
  • src/layout/cute_layout.h
  • src/layout/gemm_layouts.cc
  • src/layout/layout.cc
  • src/layout/layout.h
  • src/layout/swizzle_mode.cc
  • src/layout/swizzle_mode.h
  • src/layout/tcgen05_layout.cc
  • src/layout/tcgen05_layout.h
  • src/layout/utils.cc
  • src/layout/utils.h
  • src/metal/CMakeLists.txt
  • src/metal/codegen/codegen_metal.cc
  • src/metal/codegen/codegen_metal.h
  • src/metal/codegen/rt_mod_metal.cc
  • src/metal/op/builtin.cc
  • src/metal/op/builtin.h
  • src/metal/op/copy.cc
  • src/metal/op/fill.cc
  • src/metal/op/gemm.cc
  • src/metal/op/transpose.cc
  • src/metal/op/utils.h
  • src/metal/target_utils.cc
  • src/metal/target_utils.h
  • src/op/atomic_add.cc
  • src/op/atomic_add.h
  • src/op/atomic_reduce.cc
  • src/op/atomic_reduce.h
  • src/op/builtin.cc
  • src/op/builtin.h
  • src/op/builtin_registry.h
  • src/op/copy.cc
  • src/op/copy.h
  • src/op/fill.cc
  • src/op/fill.h
  • src/op/gemm.cc
  • src/op/gemm.h
  • src/op/gemm_sp.cc
  • src/op/gemm_sp.h
  • src/op/logical.cc
  • src/op/math.cc
  • src/op/operator.cc
  • src/op/operator.h
  • src/op/parallel.cc
  • src/op/parallel.h
  • src/op/reduce.cc
  • src/op/reduce.h
  • src/op/reducer.cc
  • src/op/reducer.h
  • src/op/scan.cc
  • src/op/scan.h
  • src/op/tcgen5_meta.h
  • src/op/transpose.cc
  • src/op/transpose.h
  • src/op/utils.cc
  • src/op/utils.h
  • src/rocm/CMakeLists.txt
  • src/rocm/codegen/codegen_hip.cc
  • src/rocm/codegen/codegen_hip.h
  • src/rocm/codegen/intrin_rule_hip.cc
  • src/rocm/codegen/rt_mod_hip.cc
  • src/rocm/op/atomic_add.cc
  • src/rocm/op/atomic_reduce.cc
  • src/rocm/op/builtin.cc
  • src/rocm/op/builtin.h
  • src/rocm/op/copy.cc
  • src/rocm/op/fill.cc
  • src/rocm/op/finalize_reducer.cc
  • src/rocm/op/gemm.cc
  • src/rocm/op/reduce.cc
  • src/rocm/op/scan.cc
  • src/rocm/op/transpose.cc
  • src/rocm/stubs/hip.cc
  • src/rocm/stubs/hip.h
  • src/rocm/stubs/hiprtc.cc
  • src/rocm/stubs/vendor/hip_runtime.h
  • src/rocm/target_utils.cc
  • src/rocm/target_utils.h
  • src/rocm/transform/async_copy_injector.cc
  • src/rocm/transform/async_copy_injector.h
  • src/runtime/error_helpers.cc
  • src/runtime/logging.cc
  • src/span_utils.cc
  • src/span_utils.h
  • src/support/check.h
  • src/tl_templates/cpp/common.h
  • src/tl_templates/cuda/atomic.h
  • src/tl_templates/cuda/barrier.h
  • src/tl_templates/cuda/cluster.h
  • src/tl_templates/cuda/common.h
  • src/tl_templates/cuda/copy.h
  • src/tl_templates/cuda/copy_sm100.h
  • src/tl_templates/cuda/copy_sm90.h
  • src/tl_templates/cuda/cuda_fp4.h
  • src/tl_templates/cuda/cuda_fp8.h
  • src/tl_templates/cuda/instruction/cute_extension/mma_sm80_sparse.hpp
  • src/tl_templates/cuda/instruction/cute_extension/mma_sm89_sparse.hpp
  • src/tl_templates/cuda/instruction/mma.h
  • src/tl_templates/cuda/instruction/mma_block_scale.h
  • src/tl_templates/cuda/instruction/mma_sp.h
  • src/tl_templates/cuda/instruction/tcgen05mma.h
  • src/tl_templates/cuda/instruction/wgmma.h
  • src/tl_templates/cuda/instruction/wgmma_sp.h
  • src/tl_templates/cuda/intrin.h
  • src/tl_templates/cuda/ldsm.h
  • src/tl_templates/cuda/math.h
  • src/tl_templates/cuda/nvrtc_std.h
  • src/tl_templates/cuda/reduce.h
  • src/tl_templates/cuda/scan.h
  • src/tl_templates/cuda/tcgen_05.h
  • src/tl_templates/cuda/tcgen_05_ld.h
  • src/tl_templates/cuda/tcgen_05_st.h
  • src/tl_templates/cuda/threadblock_swizzle.h
  • src/tl_templates/hip/atomic.h
  • src/tl_templates/hip/common.h
  • src/tl_templates/hip/copy.h
  • src/tl_templates/hip/hip_fp4.h
  • src/tl_templates/hip/hip_fp8.h
  • src/tl_templates/hip/ldsm.h
  • src/tl_templates/hip/reduce.h
  • src/tl_templates/hip/scan.h
  • src/transform/annotate_device_regions.cc
  • src/transform/annotate_read_only_params.cc
  • src/transform/canonicalize_legacy_reducer.cc
  • src/transform/common/access_ptr_utils.h
  • src/transform/common/assume.cc
  • src/transform/common/assume.h
  • src/transform/common/attr.h
  • src/transform/common/bind_utils.h
  • src/transform/common/collector.h
  • src/transform/common/constr_visitor.h
  • src/transform/common/int64_promoter.h
  • src/transform/common/loop_fusion_utils.h
  • src/transform/common/loop_vectorization_utils.h
  • src/transform/common/mbarrier.h
  • src/transform/common/pipeline_utils.h
  • src/transform/common/storage_size.h
  • src/transform/common/warp_specialize.h
  • src/transform/config_index_bitwidth.cc
  • src/transform/flatten_buffer.cc
  • src/transform/frontend_legalize.cc
  • src/transform/hoist_global_buffer_allocations.cc
  • src/transform/hoist_nonrestrict_params.cc
  • src/transform/if_stmt_binding.cc
  • src/transform/inject_assumes.cc
  • src/transform/inject_pipeline.cc
  • src/transform/layout_inference/layout_cost_model.cc
  • src/transform/layout_inference/layout_cost_model.h
  • src/transform/layout_inference/layout_inference.cc
  • src/transform/layout_inference/parallel_loop_layout_validator.h
  • src/transform/legalize_negative_index.cc
  • src/transform/legalize_safe_memory_access.cc
  • src/transform/legalize_vectorized_loop.cc
  • src/transform/loop_partition.cc
  • src/transform/loop_partition.h
  • src/transform/loop_unswitching.cc
  • src/transform/loop_vectorize.cc
  • src/transform/loop_vectorize.h
  • src/transform/lower_access_ptr.cc
  • src/transform/lower_device_kernel_launch.cc
  • src/transform/lower_intrin.cc
  • src/transform/lower_opaque_block.cc
  • src/transform/lower_thread_allreduce.cc
  • src/transform/lower_tile_op.cc
  • src/transform/make_packed_api.cc
  • src/transform/materialize_kernel_launch.cc
  • src/transform/merge_if_stmt.cc
  • src/transform/merge_if_stmt.h
  • src/transform/merge_shared_memory_allocations.cc
  • src/transform/pipeline_planning.cc
  • src/transform/plan_update_buffer_allocation_location.cc
  • src/transform/reducer_plan_materialize.cc
  • src/transform/simplify.cc
  • src/transform/split_host_device.cc
  • src/transform/storage_rewrite.cc
  • src/transform/thread_storage_sync.cc
  • src/transform/tvm_ffi_binder.cc
  • src/transform/tvm_ffi_binder.h
  • src/transform/unroll_loop.cc
  • src/transform/vectorize_loop.cc
  • src/transform/verify_buffer_init.cc
  • src/transform/verify_parallel_loop.cc
  • src/transform/verify_reducer_consumed.cc
  • src/transform/verify_reducer_epoch.cc
  • src/webgpu/CMakeLists.txt
  • src/webgpu/op/copy.cc
  • src/webgpu/op/fill.cc
  • src/webgpu/op/transpose.cc
  • testing/conftest.py
  • testing/python/amd/test_mfma_dtype_str_bug.py
  • testing/python/amd/test_tilelang_ds_read_tr.py
  • testing/python/amd/test_tilelang_gemm_mfma_intrinsic.py
  • testing/python/amd/test_tilelang_gemm_mfma_preshuffle.py
  • testing/python/amd/test_tilelang_gfx950_copy_async.py
  • testing/python/amd/test_tilelang_hip_atomic_load_store.py
  • testing/python/amd/test_tilelang_hip_atomic_return_prev.py
  • testing/python/amd/test_tilelang_hip_codegen.py
  • testing/python/amd/test_tilelang_hip_gemm_block_size.py
  • testing/python/amd/test_tilelang_hip_vector_select_codegen.py
  • testing/python/amd/test_tilelang_mxfp4_gfx950.py
  • testing/python/analysis/test_tilelang_parallel_local_index_checker.py
  • testing/python/arith/test_arith_hard.py
  • testing/python/arith/test_arith_intset.py
  • testing/python/arith/test_arith_iter_affine_map.py
  • testing/python/arith/test_arith_simplify.py
  • testing/python/autotune/test_autotune_cache_key.py
  • testing/python/autotune/test_pass_configs_tuning.py
  • testing/python/autotune/test_tilelang_autotune.py
  • testing/python/autotune/test_tilelang_autotune_atomic_save.py
  • testing/python/autotune/test_tilelang_autotune_cutedsl_cache.py
  • testing/python/autotune/test_tilelang_autotune_do_not_specialize.py
  • testing/python/autotune/test_tilelang_autotune_scalar_inputs.py
  • testing/python/autotune/test_tilelang_autotune_timeout.py
  • testing/python/backend/test_tilelang_backend_module.py
  • testing/python/cache/test_tilelang_cuda_binary_cache.py
  • testing/python/cache/test_tilelang_kernel_cache.py
  • testing/python/cache/test_tilelang_kernel_cache_atomic_save.py
  • testing/python/cache/test_tilelang_kernel_cache_integrity.py
  • testing/python/carver/test_tilelang_carver_hint.py
  • testing/python/carver/test_tilelang_carver_sm_version.py
  • testing/python/components/test_cuda_shared_memory_alias_codegen.py
  • testing/python/components/test_storage_rewrite_detect_inplace.py
  • testing/python/components/test_tilelang_env.py
  • testing/python/components/test_tilelang_pass_config_fast_math.py
  • testing/python/contrib/test_tilelang_contrib_cc.py
  • testing/python/cpu/test_tilelang_cpu_atomic.py
  • testing/python/cpu/test_tilelang_cpu_fp16_const.py
  • testing/python/cpu/test_tilelang_cpu_gemm.py
  • testing/python/cpu/test_tilelang_cpu_reduce.py
  • testing/python/cpu/test_tilelang_cpu_tgemm.py
  • testing/python/cpu/test_tilelang_cpu_transpose.py
  • testing/python/cpu/test_tilelang_cpu_vec_type.py
  • testing/python/cpu/test_tilelang_cpu_while_repro.py
  • testing/python/cuda/test_cuda_bfloat16_math_intrinsics.py
  • testing/python/cuda/test_cuda_f32x2_intrinsics.py
  • testing/python/cuda/test_cuda_mma_sm75_dispatch.py
  • testing/python/cuda/test_tilelang_cuda_tcgen05_operand_layout.py
  • testing/python/cuda/test_tma_dsmem.py
  • testing/python/cuda/test_tma_multicast_demo.py
  • testing/python/debug/test_lower_trace.py
  • testing/python/debug/test_pass_diff.py
  • testing/python/debug/test_pass_events.py
  • testing/python/debug/test_pass_timing.py
  • testing/python/debug/test_pass_visualizer.py
  • testing/python/debug/test_tilelang_debug_print.py
  • testing/python/fastmath/test_mathops_fastmath.py
  • testing/python/issue/test_tilelang_bf16x2_pack_special_values.py
  • testing/python/issue/test_tilelang_int8x32_shift_ub.py
  • testing/python/issue/test_tilelang_issue_2123.py
  • testing/python/issue/test_tilelang_issue_2188.py
  • testing/python/issue/test_tilelang_issue_2292.py
  • testing/python/issue/test_tilelang_issue_2307.py
  • testing/python/issue/test_tilelang_issue_2365.py
  • testing/python/issue/test_tilelang_issue_2433.py
  • testing/python/issue/test_tilelang_issue_2480.py
  • testing/python/issue/test_tilelang_issue_2522.py
  • testing/python/issue/test_tilelang_issue_2524.py
  • testing/python/issue/test_tilelang_issue_2528.py
  • testing/python/issue/test_tilelang_issue_2529.py
  • testing/python/issue/test_tilelang_issue_2537.py
  • testing/python/issue/test_tilelang_issue_2554.py
  • testing/python/issue/test_tilelang_issue_2600.py
  • testing/python/issue/test_tilelang_issue_2615.py
  • testing/python/issue/test_tilelang_issue_2624.py
  • testing/python/issue/test_tilelang_issue_2628.py
  • testing/python/issue/test_tilelang_issue_2632.py
  • testing/python/issue/test_tilelang_issue_2635.py
  • testing/python/issue/test_tilelang_issue_2682.py
  • testing/python/issue/test_tilelang_issue_2883.py
  • testing/python/issue/test_tilelang_issue_2928.py
  • testing/python/issue/test_tilelang_issue_2994.py
  • testing/python/issue/test_tilelang_issue_3025.py
  • testing/python/issue/test_tilelang_issue_3035.py
  • testing/python/issue/test_tilelang_issue_merge_if.py
  • testing/python/issue/test_tilelang_issue_serial_fragment_access.py
  • testing/python/issue/test_tilelang_issue_sm120_tma_smem_alignment.py
  • testing/python/issue/test_tilelang_issue_tma_no_ws.py
  • testing/python/issue/test_tilelang_issue_ws_simt_copy_full_producer_extent.py
  • testing/python/issue/test_tilelang_u32_signed_decode.py
  • testing/python/jit/test_tilelang_jit_adapter_wrapper.py
  • testing/python/jit/test_tilelang_jit_argument_binding.py
  • testing/python/jit/test_tilelang_jit_cutedsl.py
  • testing/python/jit/test_tilelang_jit_cutedsl_host_codegen.py
  • testing/python/jit/test_tilelang_jit_diagnostics.py
  • testing/python/jit/test_tilelang_jit_nvrtc.py
  • testing/python/jit/test_tilelang_jit_nvrtc_host.py
  • testing/python/jit/test_tilelang_jit_nvrtc_include_paths.py
  • testing/python/jit/test_tilelang_jit_tvm_ffi.py
  • testing/python/jit/test_tilelang_jit_tvm_ffi_executable.py
  • testing/python/kernel/test_tilelang_kernel_gemm.py
  • testing/python/kernel/test_tilelang_kernel_gemm_simt.py
  • testing/python/kernel/test_tilelang_kernel_gemm_sm75.py
  • testing/python/kernel/test_tilelang_kernel_sm70_fragment_copy.py
  • testing/python/kernel/test_tilelang_kernel_sm70_gemm_fma.py
  • testing/python/kernel/test_tilelang_kernel_sm75_gemm_fma.py
  • testing/python/language/test_tilelang_cast_rounding.py
  • testing/python/language/test_tilelang_language_access_ptr.py
  • testing/python/language/test_tilelang_language_alloc.py
  • testing/python/language/test_tilelang_language_assume.py
  • testing/python/language/test_tilelang_language_atom_mma.py
  • testing/python/language/test_tilelang_language_atomic.py
  • testing/python/language/test_tilelang_language_ceildiv.py
  • testing/python/language/test_tilelang_language_clamp.py
  • testing/python/language/test_tilelang_language_clear.py
  • testing/python/language/test_tilelang_language_cluster.py
  • testing/python/language/test_tilelang_language_copy.py
  • testing/python/language/test_tilelang_language_dialect.py
  • testing/python/language/test_tilelang_language_dtype_as_torch.py
  • testing/python/language/test_tilelang_language_eager_ast_signature.py
  • testing/python/language/test_tilelang_language_eager_jit.py
  • testing/python/language/test_tilelang_language_extract_lane.py
  • testing/python/language/test_tilelang_language_fastmath.py
  • testing/python/language/test_tilelang_language_float4_e2m1_unpacked_dtype.py
  • testing/python/language/test_tilelang_language_frontend_v2.py
  • testing/python/language/test_tilelang_language_func_attrs.py
  • testing/python/language/test_tilelang_language_get_warp_info.py
  • testing/python/language/test_tilelang_language_infinity.py
  • testing/python/language/test_tilelang_language_int64.py
  • testing/python/language/test_tilelang_language_intrinsics_codegen.py
  • testing/python/language/test_tilelang_language_kernel_threads.py
  • testing/python/language/test_tilelang_language_ldst.py
  • testing/python/language/test_tilelang_language_let.py
  • testing/python/language/test_tilelang_language_nvf4_mma_block_scale.py
  • testing/python/language/test_tilelang_language_pdl.py
  • testing/python/language/test_tilelang_language_ptr.py
  • testing/python/language/test_tilelang_language_rand.py
  • testing/python/language/test_tilelang_language_reduce.py
  • testing/python/language/test_tilelang_language_reduce_maxmin_nan.py
  • testing/python/language/test_tilelang_language_reducer_v2.py
  • testing/python/language/test_tilelang_language_reshape.py
  • testing/python/language/test_tilelang_language_scan.py
  • testing/python/language/test_tilelang_language_select.py
  • testing/python/language/test_tilelang_language_span.py
  • testing/python/language/test_tilelang_language_sync_threads.py
  • testing/python/language/test_tilelang_language_tcgen05_cutedsl.py
  • testing/python/language/test_tilelang_language_tcgen05_gemm.py
  • testing/python/language/test_tilelang_language_tcgen05_sliced_operands.py
  • testing/python/language/test_tilelang_language_tile_schedule.py
  • testing/python/language/test_tilelang_language_tma_1d.py
  • testing/python/language/test_tilelang_language_tma_copy.py
  • testing/python/language/test_tilelang_language_tma_gather_scatter.py
  • testing/python/language/test_tilelang_language_tma_store.py
  • testing/python/language/test_tilelang_language_tmem_copy.py
  • testing/python/language/test_tilelang_language_transpose.py
  • testing/python/language/test_tilelang_language_var_init.py
  • testing/python/language/test_tilelang_language_vectorize.py
  • testing/python/language/test_tilelang_language_vectorized_cast.py
  • testing/python/language/test_tilelang_language_view.py
  • testing/python/language/test_tilelang_language_warp_reduce.py
  • testing/python/language/test_tilelang_language_warp_sync.py
  • testing/python/language/test_tilelang_language_warp_vote.py
  • testing/python/language/test_tilelang_language_wgmma_gemm.py
  • testing/python/language/test_tilelang_memory_leak.py
  • testing/python/layout/test_tilelang_bank_swizzle_expand.py
  • testing/python/layout/test_tilelang_cute.py
  • testing/python/layout/test_tilelang_layout_equal.py
  • testing/python/layout/test_tilelang_layout_inference.py
  • testing/python/layout/test_tilelang_layout_inference_z3_context.py
  • testing/python/layout/test_tilelang_layout_inverse.py
  • testing/python/layout/test_tilelang_layout_linearized_index.py
  • testing/python/layout/test_tilelang_tcgen05_expand.py
  • testing/python/llvm/test_tilelang_llvm_atomic.py
  • testing/python/llvm/test_tilelang_llvm_gemm.py
  • testing/python/llvm/test_tilelang_llvm_reduce.py
  • testing/python/llvm/test_tilelang_llvm_tgemm.py
  • testing/python/llvm/test_tilelang_llvm_while_repro.py
  • testing/python/math/test_math_fast_math.py
  • testing/python/math/test_math_ieee_math.py
  • testing/python/metal/test_metal_address_space.py
  • testing/python/metal/test_metal_bf16_codegen.py
  • testing/python/metal/test_metal_cache.py
  • testing/python/metal/test_metal_gemm_v2.py
  • testing/python/metal/test_metal_gemm_v2_linux.py
  • testing/python/metal/test_metal_simdgroup_store.py
  • testing/python/profiler/test_bench_cupti.py
  • testing/python/quantize/test_tilelang_quantize_fp8.py
  • testing/python/quantize/test_tilelang_quantize_nvfp4_scale_layout.py
  • testing/python/runtime/test_tilelang_runtime_tma_validation.py
  • testing/python/target/test_tilelang_alloc_barrier_target_guard.py
  • testing/python/target/test_tilelang_codegen_cutedsl_cp_async.py
  • testing/python/target/test_tilelang_codegen_cutedsl_integer_shift.py
  • testing/python/target/test_tilelang_codegen_cutedsl_reduce.py
  • testing/python/target/test_tilelang_codegen_cutedsl_scan.py
  • testing/python/target/test_tilelang_rocm_target.py
  • testing/python/target/test_tilelang_target.py
  • testing/python/test_version_provider.py
  • testing/python/tilelibrary/test_tilelang_tilelibrary_gemm_sp.py
  • testing/python/tools/test_tilelang_tools_analyzer.py
  • testing/python/tools/test_tilelang_tools_autodd.py
  • testing/python/tools/test_tilelang_tools_compile_only.py
  • testing/python/tools/test_tilelang_tools_cuda_iket.py
  • testing/python/transform/test_readonly_param_const_codegen.py
  • testing/python/transform/test_tilelang_codegen_line_directives.py
  • testing/python/transform/test_tilelang_transform_Inject_software_pipeline.py
  • testing/python/transform/test_tilelang_transform_decouple_type_cast.py
  • testing/python/transform/test_tilelang_transform_disable_memory_reuse.py
  • testing/python/transform/test_tilelang_transform_flatten_buffer.py
  • testing/python/transform/test_tilelang_transform_fuse_mbarrier_arrive_expect_tx.py
  • testing/python/transform/test_tilelang_transform_hoist_broadcast_values.py
  • testing/python/transform/test_tilelang_transform_if_stmt_binding.py
  • testing/python/transform/test_tilelang_transform_im2col_fallback.py
  • testing/python/transform/test_tilelang_transform_inject_fence_proxy.py
  • testing/python/transform/test_tilelang_transform_inject_set_max_nreg.py
  • testing/python/transform/test_tilelang_transform_inject_tcgen05_fence.py
  • testing/python/transform/test_tilelang_transform_layout_inference.py
  • testing/python/transform/test_tilelang_transform_legalize_negative_index.py
  • testing/python/transform/test_tilelang_transform_legalize_safe_memory_access.py
  • testing/python/transform/test_tilelang_transform_let_inline.py
  • testing/python/transform/test_tilelang_transform_lexical_alloc_scope.py
  • testing/python/transform/test_tilelang_transform_loop_unswitching.py
  • testing/python/transform/test_tilelang_transform_loop_vectorize.py
  • testing/python/transform/test_tilelang_transform_lower_device_kernel_launch.py
  • testing/python/transform/test_tilelang_transform_lower_hopper_intrin.py
  • testing/python/transform/test_tilelang_transform_lower_ldgstg.py
  • testing/python/transform/test_tilelang_transform_lower_shared_barrier.py
  • testing/python/transform/test_tilelang_transform_lower_shared_tmem.py
  • testing/python/transform/test_tilelang_transform_lower_tile_op.py
  • testing/python/transform/test_tilelang_transform_make_packed_api.py
  • testing/python/transform/test_tilelang_transform_materialize_ws_schedule.py
  • testing/python/transform/test_tilelang_transform_pipeline_barrier_ownership.py
  • testing/python/transform/test_tilelang_transform_pipeline_planning.py
  • testing/python/transform/test_tilelang_transform_plan_update_buffer_allocation_location.py
  • testing/python/transform/test_tilelang_transform_preserve_loop_step.py
  • testing/python/transform/test_tilelang_transform_producer_consumer_ws.py
  • testing/python/transform/test_tilelang_transform_producer_consumer_ws_persistent.py
  • testing/python/transform/test_tilelang_transform_simplify.py
  • testing/python/transform/test_tilelang_transform_smem_swizzle_alignment.py
  • testing/python/transform/test_tilelang_transform_span_preservation.py
  • testing/python/transform/test_tilelang_transform_split_host_device.py
  • testing/python/transform/test_tilelang_transform_thread_sync.py
  • testing/python/transform/test_tilelang_transform_tmem_arena_packing.py
  • testing/python/transform/test_tilelang_transform_tmem_physical_shape.py
  • testing/python/transform/test_tilelang_transform_unroll_loop.py
  • testing/python/transform/test_tilelang_transform_verify_buffer_init.py
  • testing/python/transform/test_tilelang_transform_verify_parallel_loop.py
  • testing/python/utils/test_compress_utils.py
  • tilelang/__init__.py
  • tilelang/_typing.py
  • tilelang/analysis/__init__.py
  • tilelang/analysis/ast_printer.py
  • tilelang/analysis/fragment_loop_checker.py
  • tilelang/analysis/layout_visual.py
  • tilelang/analysis/nested_loop_checker.py
  • tilelang/analysis/parallel_local_index_checker.py
  • tilelang/autodd.py
  • tilelang/autotuner/grouped_compile.py
  • tilelang/autotuner/param.py
  • tilelang/autotuner/tuner.py
  • tilelang/backend/README.md
  • tilelang/backend/__init__.py
  • tilelang/backend/device_codegen.py
  • tilelang/backend/execution_backend.py
  • tilelang/backend/host_codegen.py
  • tilelang/backend/module.py
  • tilelang/backend/pass_pipeline/__init__.py
  • tilelang/backend/pass_pipeline/pipeline.py
  • tilelang/backend/pass_pipeline/pipeline_utils.py
  • tilelang/backend/target.py
  • tilelang/cache/__init__.py
  • tilelang/cache/cuda_binary_cache.py
  • tilelang/cache/kernel_cache.py
  • tilelang/carver/README.md
  • tilelang/carver/__init__.py
  • tilelang/carver/analysis.py
  • tilelang/carver/arch/__init__.py
  • tilelang/carver/arch/cdna.py
  • tilelang/carver/arch/cuda.py
  • tilelang/carver/arch/driver/cuda_driver.py
  • tilelang/carver/arch/metal.py
  • tilelang/carver/arch/rdna.py
  • tilelang/carver/common_schedules.py
  • tilelang/carver/matmul_analysis.py
  • tilelang/carver/roller/hint.py
  • tilelang/carver/roller/node.py
  • tilelang/carver/roller/policy/default.py
  • tilelang/carver/roller/policy/tensorcore.py
  • tilelang/carver/roller/shape_inference/tir.py
  • tilelang/carver/template/base.py
  • tilelang/carver/template/conv.py
  • tilelang/carver/utils.py
  • tilelang/contrib/cc.py
  • tilelang/contrib/cutedsl/__init__.py
  • tilelang/contrib/cutedsl/atomic.py
  • tilelang/contrib/cutedsl/cluster.py
  • tilelang/contrib/cutedsl/cpasync.py
  • tilelang/contrib/cutedsl/gemm_tcgen05.py
  • tilelang/contrib/cutedsl/grid_sync.py
  • tilelang/contrib/cutedsl/ieee_math.py
  • tilelang/contrib/cutedsl/ldsm.py
  • tilelang/contrib/cutedsl/math.py
  • tilelang/contrib/cutedsl/quantize.py
  • tilelang/contrib/cutedsl/reduce.py
  • tilelang/contrib/cutedsl/threadblock_swizzle.py
  • tilelang/contrib/cutedsl/utils.py
  • tilelang/contrib/cutedsl/warp.py
  • tilelang/contrib/hip_resource_info.py
  • tilelang/contrib/hipcc.py
  • tilelang/contrib/msvc.py
  • tilelang/contrib/nvcc.py
  • tilelang/cpu/__init__.py
  • tilelang/cpu/_ffi_api.py
  • tilelang/cpu/backend.py
  • tilelang/cpu/codegen.py
  • tilelang/cpu/execution_backend.py
  • tilelang/cpu/language/__init__.py
  • tilelang/cpu/op/__init__.py
  • tilelang/cpu/op/gemm/__init__.py
  • tilelang/cpu/op/gemm/gemm_scalar.py
  • tilelang/cpu/pipeline.py
  • tilelang/cpu/transform/__init__.py
  • tilelang/cuda/__init__.py
  • tilelang/cuda/_ffi_api.py
  • tilelang/cuda/backend.py
  • tilelang/cuda/codegen.py
  • tilelang/cuda/cutedsl_backend.py
  • tilelang/cuda/debug.py
  • tilelang/cuda/execution_backend.py
  • tilelang/cuda/intrinsics/__init__.py
  • tilelang/cuda/intrinsics/layout/__init__.py
  • tilelang/cuda/intrinsics/layout/mma_layout.py
  • tilelang/cuda/intrinsics/layout/mma_sm100_layout.py
  • tilelang/cuda/intrinsics/layout/mma_sm70_layout.py
  • tilelang/cuda/intrinsics/layout/mma_sp_layout.py
  • tilelang/cuda/intrinsics/layout/utils.py
  • tilelang/cuda/intrinsics/macro/__init__.py
  • tilelang/cuda/intrinsics/macro/mma_macro_generator.py
  • tilelang/cuda/intrinsics/macro/mma_sm120_macro_generator.py
  • tilelang/cuda/intrinsics/macro/mma_sm70_macro_generator.py
  • tilelang/cuda/intrinsics/macro/mma_sm75_macro_generator.py
  • tilelang/cuda/intrinsics/macro/mma_sp_macro_generator.py
  • tilelang/cuda/intrinsics/macro/tcgen05_macro_generator.py
  • tilelang/cuda/intrinsics/macro/wgmma_macro_generator.py
  • tilelang/cuda/intrinsics/macro/wgmma_sp_macro_generator.py
  • tilelang/cuda/intrinsics/sparse_layout.py
  • tilelang/cuda/language/__init__.py
  • tilelang/cuda/language/cluster.py
  • tilelang/cuda/language/intrinsics.py
  • tilelang/cuda/language/pdl.py
  • tilelang/cuda/language/print.py
  • tilelang/cuda/language/random.py
  • tilelang/cuda/language/tir.py
  • tilelang/cuda/language/warpgroup.py
  • tilelang/cuda/op/__init__.py
  • tilelang/cuda/op/gemm/__init__.py
  • tilelang/cuda/op/gemm/gemm_fma.py
  • tilelang/cuda/op/gemm/gemm_mma.py
  • tilelang/cuda/op/gemm/gemm_mma_sm120.py
  • tilelang/cuda/op/gemm/gemm_mma_sm70.py
  • tilelang/cuda/op/gemm/gemm_mma_sm75.py
  • tilelang/cuda/op/gemm/gemm_tcgen05.py
  • tilelang/cuda/op/gemm/gemm_wgmma.py
  • tilelang/cuda/op/gemm_sp/__init__.py
  • tilelang/cuda/op/gemm_sp/gemm_sp_mma.py
  • tilelang/cuda/op/gemm_sp/gemm_sp_wgmma.py
  • tilelang/cuda/pipeline.py
  • tilelang/cuda/target.py
  • tilelang/cuda/transform/__init__.py
  • tilelang/engine/callback.py
  • tilelang/engine/lower.py
  • tilelang/engine/param.py
  • tilelang/engine/semantic_check.py
  • tilelang/env.py
  • tilelang/errors.py
  • tilelang/instrumentation/__init__.py
  • tilelang/instrumentation/events.py
  • tilelang/instrumentation/session.py
  • tilelang/ir.py
  • tilelang/jit/__init__.py
  • tilelang/jit/abi.py
  • tilelang/jit/adapter/__init__.py
  • tilelang/jit/adapter/base.py
  • tilelang/jit/adapter/cutedsl/adapter.py
  • tilelang/jit/adapter/cutedsl/checks.py
  • tilelang/jit/adapter/cutedsl/kernel_cache.py
  • tilelang/jit/adapter/cutedsl/libgen.py
  • tilelang/jit/adapter/cutedsl/wrapper.py
  • tilelang/jit/adapter/cython/adapter.py
  • tilelang/jit/adapter/cython/cython_wrapper.pyx
  • tilelang/jit/adapter/kernel_cache.py
  • tilelang/jit/adapter/libgen.py
  • tilelang/jit/adapter/nvrtc/adapter.py
  • tilelang/jit/adapter/nvrtc/include_paths.py
  • tilelang/jit/adapter/nvrtc/libgen.py
  • tilelang/jit/adapter/nvrtc/wrapper.py
  • tilelang/jit/adapter/torch/metal.py
  • tilelang/jit/adapter/tvm_ffi.py
  • tilelang/jit/adapter/utils.py
  • tilelang/jit/adapter/wrapper.py
  • tilelang/jit/diagnostics.py
  • tilelang/jit/kernel.py
  • tilelang/language/__init__.py
  • tilelang/language/allocate.py
  • tilelang/language/annotations.py
  • tilelang/language/ast/__init__.py
  • tilelang/language/ast/_ffi_api.py
  • tilelang/language/ast/ir.py
  • tilelang/language/atomic.py
  • tilelang/language/builtin.py
  • tilelang/language/common.py
  • tilelang/language/copy_op.py
  • tilelang/language/customize.py
  • tilelang/language/dtypes.py
  • tilelang/language/eager/__init__.py
  • tilelang/language/eager/ast.py
  • tilelang/language/eager/builder.py
  • tilelang/language/eager/utils.py
  • tilelang/language/experimental/gemm_sp_op.py
  • tilelang/language/fill_op.py
  • tilelang/language/fp8.py
  • tilelang/language/frame.py
  • tilelang/language/gemm_op.py
  • tilelang/language/kernel.py
  • tilelang/language/logical.py
  • tilelang/language/loop.py
  • tilelang/language/math_intrinsics.py
  • tilelang/language/meta.py
  • tilelang/language/overrides/buffer.py
  • tilelang/language/overrides/parser.py
  • tilelang/language/parser/entry.py
  • tilelang/language/parser/operation.py
  • tilelang/language/parser/parser.py
  • tilelang/language/proxy.py
  • tilelang/language/reduce_op.py
  • tilelang/language/scan_op.py
  • tilelang/language/symbolics.py
  • tilelang/language/tile_schedule.py
  • tilelang/language/tir/common.py
  • tilelang/language/tir/entry.py
  • tilelang/language/tir/exports.py
  • tilelang/language/tir/ir.py
  • tilelang/language/tir/ir.pyi
  • tilelang/language/tir/op.py
  • tilelang/language/utils.py
  • tilelang/language/ws_schedule.py
  • tilelang/layout/__init__.py
  • tilelang/layout/_cute_ffi_api.py
  • tilelang/layout/cute.py
  • tilelang/layout/fragment.py
  • tilelang/layout/gemm_sp.py
  • tilelang/layout/layout.py
  • tilelang/layout/partial_fragment.py
  • tilelang/layout/swizzle.py
  • tilelang/layout/swizzle_mode.py
  • tilelang/libinfo.py
  • tilelang/metal/__init__.py
  • tilelang/metal/backend.py
  • tilelang/metal/codegen.py
  • tilelang/metal/execution_backend.py
  • tilelang/metal/intrinsics/__init__.py
  • tilelang/metal/intrinsics/metal_macro_generator.py
  • tilelang/metal/language/__init__.py
  • tilelang/metal/language/tir.py
  • tilelang/metal/op/__init__.py
  • tilelang/metal/op/gemm/__init__.py
  • tilelang/metal/op/gemm/gemm_metal.py
  • tilelang/metal/pipeline.py
  • tilelang/metal/target.py
  • tilelang/metal/transform/__init__.py
  • tilelang/metal/transform/mark_host_metal_context.py
  • tilelang/metal/transform/metal_fragment_to_simdgroup.py
  • tilelang/metal/utils.py
  • tilelang/profiler/__init__.py
  • tilelang/profiler/bench.py
  • tilelang/rocm/__init__.py
  • tilelang/rocm/backend.py
  • tilelang/rocm/codegen.py
  • tilelang/rocm/execution_backend.py
  • tilelang/rocm/intrinsics/__init__.py
  • tilelang/rocm/intrinsics/mfma_layout.py
  • tilelang/rocm/intrinsics/mfma_macro_generator.py
  • tilelang/rocm/intrinsics/utils.py
  • tilelang/rocm/intrinsics/wmma_layout.py
  • tilelang/rocm/intrinsics/wmma_macro_generator.py
  • tilelang/rocm/language/__init__.py
  • tilelang/rocm/language/intrinsics.py
  • tilelang/rocm/language/tir.py
  • tilelang/rocm/op/__init__.py
  • tilelang/rocm/op/gemm/__init__.py
  • tilelang/rocm/op/gemm/gemm_mfma.py
  • tilelang/rocm/op/gemm/gemm_wmma.py
  • tilelang/rocm/pipeline.py
  • tilelang/rocm/target.py
  • tilelang/testing/__init__.py
  • tilelang/testing/perf_regression.py
  • tilelang/tileop/__init__.py
  • tilelang/tileop/gemm/__init__.py
  • tilelang/tileop/gemm/gemm_base.py
  • tilelang/tileop/gemm/registry.py
  • tilelang/tileop/gemm_sp/__init__.py
  • tilelang/tileop/gemm_sp/gemm_sp_base.py
  • tilelang/tileop/gemm_sp/registry.py
  • tilelang/tools/Analyzer.py
  • tilelang/tools/__init__.py
  • tilelang/tools/compile_only.py
  • tilelang/tools/cuda/__init__.py
  • tilelang/tools/cuda/iket/__init__.py
  • tilelang/tools/cuda/iket/cli.py
  • tilelang/tools/cuda/iket/codegen.py
  • tilelang/tools/cuda/iket/frontend.py
  • tilelang/tools/cuda/iket/metadata.py
  • tilelang/tools/cuda/iket/session.py
  • tilelang/tools/lower_trace/__init__.py
  • tilelang/tools/lower_trace/core.py
  • tilelang/tools/lower_trace/diff.py
  • tilelang/tools/lower_trace/html.py
  • tilelang/tools/pass_timing.py
  • tilelang/tools/pass_visualizer/README.md
  • tilelang/tools/pass_visualizer/__init__.py
  • tilelang/tools/pass_visualizer/core.py
  • tilelang/tools/pass_visualizer/examples/gemm_relu.py
  • tilelang/tools/pass_visualizer/viewer.py
  • tilelang/transform/__init__.py
  • tilelang/transform/add_bufstore_wrapper.py
  • tilelang/transform/decouple_type_cast.py
  • tilelang/transform/hoist_broadcast_values.py
  • tilelang/transform/pass_config.py
  • tilelang/transform/simplify.py
  • tilelang/utils/__init__.py
  • tilelang/utils/device.py
  • tilelang/utils/language.py
  • tilelang/utils/pass_diff.py
  • tilelang/utils/pass_diff_hook.py
  • tilelang/utils/tensor.py
  • tilelang/webgpu/__init__.py
  • tilelang/webgpu/backend.py
  • tilelang/webgpu/codegen.py
  • tilelang/webgpu/language/__init__.py
  • tilelang/webgpu/pipeline.py
  • version_provider.py
  • 3rdparty/composable_kernel
  • benchmark/matmul/benchmark_matmul_intrinsic.py
  • examples/gemm_fp8/example_tilelang_gemm_fp8_intrinsic.py
  • examples/gemm_sm100/README.md
  • examples/gemm_sm100/gemm_mma.py
  • examples/gemm_sm100/gemm_tcgen5mma.py
  • examples/gemm_sm100/gemm_tcgen5mma_ws.py
  • examples/gemm_sm100/gemm_tcgen5mma_ws_clc.py
  • examples/gemm_sm100/gemm_tcgen5mma_ws_persistent.py
  • examples/gemm_sp/example_custom_compress.py
  • examples/sparse_tensorcore/regression_example_sparse_tensorcore.py
  • examples/sparse_tensorcore/test_example_sparse_tensorcore.py
  • examples/sparse_tensorcore/tilelang_example_sparse_tensorcore.py
  • examples/topk/regression_topk_tilelang.py
  • src/backend/cuda/CMakeLists.txt
  • src/backend/metal/CMakeLists.txt
  • src/backend/rocm/CMakeLists.txt
  • src/op/finalize_reducer.cc
  • src/op/finalize_reducer.h
  • src/op/gemm_sp_py.cc
  • src/op/gemm_sp_py.h
  • src/op/region.cc
  • src/op/region.h
  • src/runtime/runtime.cc
  • src/runtime/runtime.h
  • src/support/ffi_aliases.h
  • src/target/codegen_c.cc
  • src/target/codegen_c.h
  • src/target/codegen_c_host.cc
  • src/target/codegen_c_host.h
  • src/target/codegen_cuda.cc
  • src/target/codegen_cuda.h
  • src/target/codegen_cutedsl.cc
  • src/target/codegen_cutedsl.h
  • src/target/codegen_hip.cc
  • src/target/codegen_hip.h
  • src/target/codegen_py.cc
  • src/target/codegen_py.h
  • src/target/codegen_utils.cc
  • src/target/codegen_utils.h
  • src/target/intrin_rule_cuda.cc
  • src/target/intrin_rule_hip.cc
  • src/target/ptx.cc
  • src/target/ptx.h
  • src/target/rt_mod_c.cc
  • src/target/rt_mod_cuda.cc
  • src/target/rt_mod_cutedsl.cc
  • src/target/rt_mod_hip.cc
  • src/target/stubs/cuda.cc
  • src/target/stubs/cuda.h
  • src/target/stubs/cudart.cc
  • src/target/stubs/hip.cc
  • src/target/stubs/hip.h
  • src/target/stubs/hiprtc.cc
  • src/target/stubs/nvrtc.cc
  • src/target/stubs/vendor/cuda.h
  • src/target/stubs/vendor/hip_runtime.h
  • src/target/utils.cc
  • src/target/utils.h
  • src/tl_templates/cuda/compress_sm90.cu
  • src/tl_templates/cuda/gemm.h
  • src/tl_templates/cuda/gemm_mma.h
  • src/tl_templates/cuda/gemm_sm100.h
  • src/tl_templates/cuda/gemm_sm120.h
  • src/tl_templates/cuda/gemm_sm70.h
  • src/tl_templates/cuda/gemm_sm80.h
  • src/tl_templates/cuda/gemm_sm89.h
  • src/tl_templates/cuda/gemm_sm90.h
  • src/tl_templates/cuda/gemm_sp.h
  • src/tl_templates/cuda/gemm_sp_sm80.h
  • src/tl_templates/cuda/gemm_sp_sm90.h
  • src/transform/annotate_warp_group_reg_alloc.cc
  • src/transform/arg_binder.cc
  • src/transform/arg_binder.h
  • src/transform/cluster_planning.cc
  • src/transform/fuse_mbarrier_arrive_expect_tx.cc
  • src/transform/inject_fence_proxy.cc
  • src/transform/inject_tcgen05_fence.cc
  • src/transform/instruction_annotation.cc
  • src/transform/layout_inference.cc
  • src/transform/layout_reducer.cc
  • src/transform/layout_reducer.h
  • src/transform/lower_blackwell_2sm.cc
  • src/transform/lower_device_storage_access_info.cc
  • src/transform/lower_hopper_intrin.cc
  • src/transform/lower_l2_persistent_annotation.cc
  • src/transform/lower_ldg_stg.cc
  • src/transform/lower_pdl.cc
  • src/transform/lower_ptx_async_copy.cc
  • src/transform/lower_shared_barrier.cc
  • src/transform/lower_shared_tmem.cc
  • src/transform/multi_version_buffer_rewriter.cc
  • src/transform/multi_version_buffer_rewriter.h
  • src/transform/parallel_loop_layout_validator.h
  • src/transform/persist_threadblock.cc
  • src/transform/producer_consumer_ws.cc
  • src/transform/ptx_async_copy_injector.h
  • testing/python/kernel/test_tilelang_kernel_bf16_gemm_mma.py
  • testing/python/kernel/test_tilelang_kernel_element_wise_add.py
  • testing/python/kernel/test_tilelang_kernel_fp8_gemm.py
  • testing/python/kernel/test_tilelang_kernel_fp8_gemm_mma.py
  • testing/python/kernel/test_tilelang_kernel_fp8_gemv_simt.py
  • testing/python/kernel/test_tilelang_kernel_gemm_mma_intrinsic.py
  • testing/python/language/test_tilelang_language_cumsum.py
  • testing/python/language/test_tilelang_language_stg.py
  • testing/python/tilelibrary/test_tilelang_tilelibrary_gemm_sp_v2.py
  • testing/python/transform/test_tilelang_transform_cluster_planning.py
  • testing/python/transform/test_tilelang_transform_lower_ptx_async_copy.py
  • tilelang/carver/roller/shape_inference/common.py
  • tilelang/common/__init__.py
  • tilelang/common/transform_kind.py
  • tilelang/contrib/dlpack.py
  • tilelang/engine/phase.py
  • tilelang/intrinsics/__init__.py
  • tilelang/intrinsics/mfma_layout.py
  • tilelang/intrinsics/mfma_macro_generator.py
  • tilelang/intrinsics/mma_layout.py
  • tilelang/intrinsics/mma_macro_generator.py
  • tilelang/intrinsics/mma_sm70_layout.py
  • tilelang/intrinsics/mma_sm70_macro_generator.py
  • tilelang/intrinsics/mma_sp_layout.py
  • tilelang/intrinsics/mma_sp_macro_generator.py
  • tilelang/intrinsics/tcgen05_macro_generator.py
  • tilelang/intrinsics/utils.py
  • tilelang/intrinsics/wgmma_macro_generator.py
  • tilelang/intrinsics/wmma_layout.py
  • tilelang/intrinsics/wmma_macro_generator.py
  • tilelang/jit/env.py
  • tilelang/jit/execution_backend.py
  • tilelang/language/cluster.py
  • tilelang/language/experimental/gemm_sp.py
  • tilelang/language/fastmath.py
  • tilelang/language/pdl.py
  • tilelang/language/print_op.py
  • tilelang/language/random.py
  • tilelang/language/warpgroup.py
  • tilelang/quantize/__init__.py
  • tilelang/quantize/lop3.py
  • tilelang/quantize/mxfp.py
  • tilelang/quantize/quantization.py
  • tilelang/quantize/utils.py
  • tilelang/tileop/gemm/gemm_mfma.py
  • tilelang/tileop/gemm/gemm_mma.py
  • tilelang/tileop/gemm/gemm_mma_sm70.py
  • tilelang/tileop/gemm/gemm_scalar.py
  • tilelang/tileop/gemm/gemm_tcgen05.py
  • tilelang/tileop/gemm/gemm_wgmma.py
  • tilelang/tileop/gemm/gemm_wmma.py
  • tilelang/tileop/gemm/inst.py
  • tilelang/tileop/gemm_sp/gemm_sp_mma.py
  • tilelang/transform/metal/__init__.py
  • tilelang/transform/metal/mark_host_metal_context.py
  • tilelang/utils/sparse.py
  • tilelang/utils/target.py

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.


Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@github-actions

Copy link
Copy Markdown

👋 Hi! Thank you for contributing to the TileLang project.

Please remember to run pre-commit run --all-files in the root directory of the project to ensure your changes are properly linted and formatted. This will help ensure your contribution passes the format check.

We appreciate you taking this step! Our team will review your contribution, and we look forward to your awesome work! 🚀

@yurekami
yurekami force-pushed the fix-alloc-barrier-validate branch from 02a7f32 to 3981b14 Compare August 29, 2026 22:11
@LeiWang1999
LeiWang1999 merged commit 958d6d3 into tile-ai:main Aug 30, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[BUG][Fuzzer][diagnostic] T.alloc_barrier(0) is accepted through the whole compile pipeline and emits Barrier::init(0) with no diagnostic

2 participants