KronLLM: a 10M-parameter bilingual English/Russian language model whose weights are Kronecker sums of rank-1 factors instead of dense matrices. Q10 (9,938,886 params) is the model; the 2-3M TinyStories runs are the development bench. Full research log, negative results included.
transformers pytorch quantization language-model bilingual kronecker llm tinystories small-language-model efficient-ml kronecker-factorization bilingual-language-model
-
Updated
Nov 15, 2026 - Python