Skip to content

perf(cuda): widen the attention query tile on sm_89 and sm_120 - #202

Open
sysuTobo wants to merge 8 commits into
InferMatrixLab:mainfrom
sysuTobo:cuda/attention-wide-tile
Open

sysuTobo wants to merge 8 commits into
InferMatrixLab:mainfrom
sysuTobo:cuda/attention-wide-tile

cuda: merge main and key every shared-memory opt-in per device

97463d1
Select commit
Loading
Failed to load commit list.
Sign in for the full log view