Repository navigation
Load vectors from the community index (replaces BUNDLED_VECTORS) - #9
Merged
Merged
Conversation
At startup the registry now combines your own vectors (registry.yaml) with the model's entries from community/vectors.yaml: verified by default, unverified community ones with include_community=True (±8 unless calibrated, and marked as unverified in the prompt). Files are fetched at their pinned revision, checked against sha256 and the model's dimensions, and cached in vectors/<model>/; a cached file that doesn't match is reported, never overwritten. Index entries live in memory only, so registry.yaml stays yours: own vectors win on a name clash and save() never writes index entries. Removes BUNDLED_VECTORS; the Qwen assistant_axis now comes from the index (same file). setup.sh fetches through the index too. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
GPU verification on Qwen2.5-7B showed odd capitalization and muddled answers at +15 that the repetition detector misses; -15 stays coherent. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Point 1 of community contributions: the library now reads
community/vectors.yaml(the repo's copy) instead of the hard-codedBUNDLED_VECTORS.How a model's vectors are assembled at startup
vectors/<model>/registry.yaml. These win on a name clash.verifiedentries load by default. Unverifiedcommunityentries load only withSteeringAgent(..., include_community=True); they're capped at ±8 unless a maintainer has calibrated them, and marked[Unverified community vector]in the model's prompt.Safety of index files
hidden_size/layer count before it's cached invectors/<model>/.registry.yamlstays yours: index entries live in memory only, andsave()never writes them. This avoids rewriting a hand-commented, tracked file on every run. A removed or demoted index entry simply stops loading.Migration
assistant_axisentry is removed from the Qwenregistry.yaml, so the index provides it, using the same committed file (sha matches, no download).setup.shfetches through the index instead of hard-coding the Butanium download.Also:
load_index/fetch_vectormove intomodulo/community.py, shared by the library, CI andgpu_verify.py. The docs (AGENTS, CONTRIBUTING, README) are updated.Testing
setup.shfetched assistant_axis through the index and loaded the model;pytest69 passed (CPU + GPU); a 3-turnrun.sh --autosession loaded the vector from the index, steered at -8 and decayed as expected.🤖 Generated with Claude Code