Skip to content

chore(deps): update loader dependencies non-major - #309

Open
dreadnode-renovate-bot[bot] wants to merge 1 commit into
mainfrom
renovate/loader-deps
Open

dreadnode-renovate-bot[bot] wants to merge 1 commit into
mainfrom
renovate/loader-deps

Conversation

@dreadnode-renovate-bot

@dreadnode-renovate-bot dreadnode-renovate-bot Bot commented Nov 18, 2026 •

Copy link
Copy Markdown
Contributor

Note

This PR body was truncated due to platform limits.

This PR contains the following updates:

| Package | Change | Age | Confidence |
|

Generated Summary:

  • Updated transformers library from version 5.22.2 to 5.23.0 in the automodel loader requirements.
  • Updated peft library from version 0.21.2 to 0.21.3 in the lora loader requirements.
  • Both updates may include bug fixes and performance improvements.
  • Compatibility with applications using these libraries should be verified after changes.

This summary was generated with ❤️ by rigging

| peft | ==0.21.2 → ==0.21.3 | age | confidence |
| transformers | ==5.22.2 → ==5.23.0 | age | confidence |


Release Notes

huggingface/peft (peft)

v0.21.3

Compare Source

Release 0.21.3 containing:

  • #​3963: Only gather adapter weights when saving a DTensor TP model

This is mostly to fix a performance penalty with huggingface/transformers#49316 as this makes Trainer call save_pretrained on every rank, and with peft 0.21.2 that gathers the whole sharded model instead of just the adapter.

What's Changed

Full Changelog: huggingface/peft@v0.21.2...v0.21.3

huggingface/transformers (transformers)

v5.23.0

Compare Source

Release v5.23.0

New Model additions

Inkling2
image

Inkling 2 Small is a multimodal model from Thinking Machines Lab that accepts text and image inputs and generates text outputs, and it is intended for use in English and other languages and across multiple coding languages. Its language backbone has 48 mixture-of-experts decoder layers, each routing tokens to 8 of 384 experts, for 594B total and 17B active parameters. It keeps the Inkling decoder (learned relative attention, short causal convolutions, mixture-of-experts layers) and adds block attention residuals, gated attention with a learned sink, and dynamic key/value convolutions. Images are encoded by a Perception Encoder-based vision transformer and projected into the language model embeddings, one embedding per 40x40 pixel patch.

Links: Documentation | Blog Post

JEV

JEV is a decision head that scores single-token labels with a linear layer at the last token of the prompt, soft-capped like the logits of a language model head. JevForDecision is the model of the checkpoint and its head, and it reads the head files shipped next to the weights (head.safetensors and judge_config.json for JEV). The same head is also used by GEV and reads the 255 answer codes of pplx-decider and d3, and it can be run through the experimental decision pipeline or directly with decide.

Note: JEV and the decision pipeline are currently experimental. Their APIs, configuration, and behavior may change as development continues. They should be used with caution in production environments.

Links: Documentation

LFM3
image

LFM3 is the third generation of Liquid Foundation Models from Liquid AI. Like LFM2, it is a hybrid architecture that combines gated short convolutions with grouped-query attention, with the attention layers split between full-attention and sliding-window layers. The attention layers apply RMSNorm to the query and key heads and gate their output with a per-head sigmoid. Every layer applies a sandwich norm to the operator and feed-forward outputs before the residual addition.

Links: Documentation

Dots 3 Note Preview

Dots 3 Note Preview is a mixture-of-experts causal language model that accepts native text, image, video, and audio inputs. It uses a shared vision encoder for images and videos and a Whisper-style audio encoder, and both encoders project their outputs into the language model's hidden space before autoregressive text generation. BF16 and FP8 inference are supported.

Links: Documentation

LFM3-VL

LFM3-VL is a vision-language model family from Liquid AI, built on the LFM3 language model. It takes images and videos at their native resolution together with text. It combines a hybrid vision encoder (a linear patchifier, gated depthwise 2D convolution layers, and bidirectional grouped-query attention layers with 2D rotary embeddings) with a projector and an LFM3 language model. The projector merges each 2x2 block of patch features into one language token through a layer norm and a two-layer MLP.

Links: Documentation

IQuestCoder

IQuest-Coder-V1 is a family of code language models developed by IQuest Lab, available in 7B, 14B and 40B sizes with base, instruct and thinking variants. Its architecture is the same as Llama, so the Transformers auto classes load it with LlamaModel and LlamaForCausalLM, and only IQuestCoderConfig is specific to IQuestCoder. The looped IQuest-Coder-V1-*-Loop-* checkpoints use a different architecture and aren't supported.

Links: Documentation

InternLM3

InternLM3 is an 8B instruction-tuned language model developed by Shanghai AI Laboratory (checkpoint: internlm/internlm3-8b-instruct). Its architecture is the same as Llama, so the auto classes load it with the Llama implementation (LlamaModel and LlamaForCausalLM), and only InternLM3Config is specific to InternLM3. The config names the attention biases qkv_bias and the output projection and MLP biases bias. InternLM3Config loads these as attention_bias and mlp_bias and requires them to be equal, as they are in the released checkpoints.

Links: Documentation

Breaking changes

Exporters: export, share and run any model on its backend (#​50029, #​50032, #​50309, #​50311)

exporters.mp4

Every export now returns an ExportedModel. You call it like the original model (same kwargs, same output class), push it to the Hub, and load it back on the backend's own runtime. The same API covers Dynamo, ONNX Runtime, OpenVINO and ExecuTorch.

from transformers import AutoModel, AutoTokenizer
from transformers.exporters import ExportedModel, OnnxConfig, OnnxExporter

model = AutoModel.from_pretrained("google/embeddinggemma-2")
tokenizer = AutoTokenizer.from_pretrained("google/embeddinggemma-2")
inputs = tokenizer(["Exporters are here!"], return_tensors="pt")

exported = OnnxExporter().export(model, inputs, OnnxConfig(dynamic=True, ort_fusions="cuda"))
exported.push_to_hub("my-org/embeddinggemma-2-onnx")

exported_model = ExportedModel.from_pretrained("my-org/embeddinggemma-2-onnx", device="cuda")
outputs = exported_model(**inputs)  # same output class as model(**inputs)
  • Fused for the runtime: OnnxConfig(ort_fusions="cpu" | "cuda" | "webgpu" | "dml") rewrites the graph into ONNX Runtime's fused transformer ops at export time: attention, GroupQueryAttention over the KV cache, rotary, norms and MoE. OpenVINO exports now hit OpenVINO's fused CPU kernels for attention, RoPE, MoE experts and compressed int8/int4 weights, which makes decode 2.4–3.9× faster than before.
  • Faster than torch.compile: on EmbeddingGemma2 (8 × 128 tokens), ONNX Runtime with the TensorRT EP is 7.6× faster than eager PyTorch and 1.4× faster than torch.compile on an A100. OpenVINO is 4.1× faster than eager and 2.2× faster than torch.compile on a Xeon Platinum 8570 (4.9× and 2.6× with int8 weights).
  • Shareable: an export saves and loads like a model, optionally in a subfolder of the model repo. Its export.json records the config, input shapes, package versions and I/O names. Quantized exports (PT2E, NNCF, ONNX Runtime) save and run the same way.

🚨 export() returns an ExportedModel, and an ONNX program is an onnx_ir.Model. OnnxConfig's and OpenVINOConfig's output_path options are gone in favour of save_pretrained. Custom backends register with register_backend.

📚 Docs: https://huggingface.co/docs/transformers/main/en/exporters

Vision

This release fixes a range of vision-model bugs: classification pipelines now respect problem_type, and several models get corrected behavior (Step3.7 RoPE axis order, MiniMax-M3-VL packed attention isolation, Qwen VL positions with reused caches, PaddleOCR-VL interpolation alignment, Kosmos2 SDPA masking, and Emu3 float image handling). Chunked prefill now keeps image inputs on the

Parallelization

This release improves distributed training and inference. Expert parallelism gains a selectable ep_implementation (all-reduce for CUDA-graph-friendly inference, all-to-all for training). The Trainer now reduces FSDP/HSDP gradients only on the last micro-batch, and the token-count normalization is fixed to use true division. Tensor-parallel fixes cover attention sinks (including Beam attention) and tied-weight comparisons on TPU

Cache

This release fixes several cache correctness issues: static-cache prefill attention in Gemma4's KV-shared layers, Qwen VL positions when a cache is reused with a new image or video, and DeepSeek-V4 compression-state reordering during beam search. It also improves cache sharing for Mistral Large 4 and adds OpenVINO export fusion for the KV cache and attention. Smaller changes cover CI and test fixes, including vLLM CI memory

Kernels

This release fixes several hub kernel issues: the MPS RMSNorm kernel repo id was corrected, the MegaBlocksMoeMLP mapping was restored for MXFP4 GPT-OSS, and a failed flash-attention kernel load is now retried instead of leaving models unregistered. It also raises the minimum kernels version (fixing ROCm issues and a multi-GPU bug), bumps mamba-ssm kernels to v4

Attention

This release fixes a range of attention bugs: vision-attention isolation in MiniMax-M3-VL, SDPA decode under torch.compile, eager NaNs in Qwen4-Exp with left padding, an unintended causal mask in Kosmos-2's SDPA projection, and default full-attention mask selection that wrongly picked linear layers. It also retries failed attention kernel loads, excludes padding from the repetition penalty, and lets the O

Generation

This release fixes several generation bugs: padded generation in RecurrentGemma, batched decoding in Falcon-H1, beam search cache reordering in DeepSeek-V4, and batched metadata and beam scores in TextGenerationPipeline. It also lets an unchanged GenerationConfig be saved without strict-validation errors, avoids copying the KV cache when decoding with grouped-query attention (GQA), and fixes an `Attribut

Quantization

This release fixes several quantization bugs: FP8 modules_to_not_convert entries are now renamed like weight names, so modules such as f_a_proj and f_b_proj are no longer wrongly quantized. MXFP4 experts now dequantize to the requested dtype instead of always using bfloat16. The MegaBlocksMoeMLP hub kernel mapping is restored for MXFP4 GPT-OSS, which fix

Audio

This release makes audio handling more correct and robust. AudioClassificationPipeline now respects the model's problem type (raw outputs for regression, sigmoid for multi-label, softmax otherwise), and VibeVoice and VibeVoice-ASR avoid GPU syncs when removing audio padding and gain a sample argument to disable VAE noise for deterministic outputs. Chat templates can also take audio decoded from video via `{"type": "aud

Bugfixes and improvements

[!IMPORTANT]
✂ PR body was truncated to here.


Configuration

📅 Schedule: (UTC)

  • Branch creation
    • At any time (no schedule defined)
  • Automerge
    • At any time (no schedule defined)

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.


  • If you want to rebase/retry this PR, check this box

This PR has been generated by Mend Renovate CLI.

| datasource | package      | from   | to     |
| ---------- | ------------ | ------ | ------ |
| pypi       | peft         | 0.21.2 | 0.21.3 |
| pypi       | transformers | 5.22.2 | 5.23.0 |
@dreadnode-renovate-bot dreadnode-renovate-bot Bot added the type/digest Dependency digest updates label Nov 18, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

type/digest Dependency digest updates

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants