Skip to content

feat(thead): add linked vLLM rms_norm and silu_and_mul - #955

Merged
voltjia merged 1 commit into
masterfrom
feat/thead-vllm-linked-rmsnorm-and-silu_and_mul
Aug 27, 2026
Merged

feat(thead): add linked vLLM rms_norm and silu_and_mul#955
voltjia merged 1 commit into
masterfrom
feat/thead-vllm-linked-rmsnorm-and-silu_and_mul

Conversation

@spike-zhu

@spike-zhu spike-zhu commented Aug 26, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Add the T-Head C10 stream adapter for linked Torch operators.
  • Add linked vLLM providers for rms_norm and silu_and_mul.

Motivation

Closes #

Type of Change

  • feat — new feature / new operator / new platform
  • fix — bug fix
  • perf — performance improvement (no behavioral change)
  • refactor — code restructuring without behavior change
  • test — adding or fixing tests only
  • docs — documentation only
  • build / ci — build system or CI configuration
  • chore — tooling, formatting, or other non-code changes
  • Breaking change (requires a ! in the Conventional Commits prefix or a BREAKING CHANGE: footer)

Platforms Affected

  • CPU (WITH_CPU)
  • NVIDIA (WITH_NVIDIA)
  • Iluvatar (WITH_ILUVATAR)
  • MetaX (WITH_METAX)
  • Cambricon (WITH_CAMBRICON)
  • Moore (WITH_MOORE)
  • Ascend (WITH_ASCEND)
  • T-Head (WITH_THEAD)
  • PyTorch C++ bindings (WITH_TORCH)
  • Build system / CMake / CI
  • Python bindings / user-facing API

Smoke Test Result

paste smoke test output here

Test Results on Supported Platforms

Platform Affected Build / Smoke Result Full Result / Notes
NVIDIA
Iluvatar
MetaX
Cambricon
Moore
Ascend
Full `pytest` output (optional)
paste here

Benchmark / Performance Impact

Notes for Reviewers

@spike-zhu
spike-zhu requested review from a team and voltjia August 26, 2026 13:13
@spike-zhu spike-zhu self-assigned this Aug 26, 2026
@spike-zhu
spike-zhu force-pushed the feat/thead-vllm-linked-rmsnorm-and-silu_and_mul branch 2 times, most recently from ef5e172 to 507da79 Compare August 26, 2026 13:29
@voltjia voltjia changed the title feat(thead): add linked vLLM rms_norm and silu_and_mul feat(thead): add linked vLLM rms_norm and silu_and_mul Aug 27, 2026
@voltjia
voltjia merged commit e67cc5d into master Aug 27, 2026
16 of 20 checks passed
@voltjia
voltjia deleted the feat/thead-vllm-linked-rmsnorm-and-silu_and_mul branch August 27, 2026 05:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants