CuTileForge v3.0.0: Native tile-fusion compiler & universal quantization engine on NVIDIA CuTile. Zero-ATen CUDA-graph decode at 172 tok/s, 2,377 tok/s batch serving, 13 model families, 70B hybrid on a single 32 GB GPU (sm_89 ↔ sm_120).
autograd moe onnx conv2d adamw gpu-runtime blackwell openai-api gptq llm-inference speculative-decoding flash-decoding torch-compile 70b rtx-5090 tile-fusion cutile cuda-graphs radix-cache compiler-sdk
-
Updated
Nov 21, 2026 - Python