anthony-maio

Triton Quantized Block Scaled Gemm

Name: Triton Quantized Block Scaled Gemm
Author: anthony-maio

AI community

SOURCE https://github.com/anthony-maio/triton-skills/blob/main/skills/triton-quantized-block-scaled-gemm.md

Description

--- name: triton-quantized-block-scaled-gemm description: Teach an AI agent how to implement block-scaled (microscaling) quantized matmul kernels in Triton. --- # Quantized & Block-Scaled Matmul Kernels in Triton > **Targets:** Triton >= 3.0; `tl.dot_scaled` requires SM100+/CDNA4; dequantize fallback works on SM70+/CDNA2+ Overview This guide explains how to implement low-precision block-scaled matrix multiplication in Triton for mxfp4/mxfp8/nvfp4 formats. It covers scale tensor layouts (OCP m

Installation

Installs to ~/.claude/skills/anthony-maio-triton-skills-triton-quantized-block-scaled-gemm/SKILL.md

Terminal

mkdir -p ~/.claude/skills/anthony-maio-triton-skills-triton-quantized-block-scaled-gemm && curl -fsSL https://raw.githubusercontent.com/anthony-maio/triton-skills/HEAD/skills/triton-quantized-block-scaled-gemm.md -o ~/.claude/skills/anthony-maio-triton-skills-triton-quantized-block-scaled-gemm/SKILL.md

Restart Claude Code, or start a new session, for it to be picked up.