Skip to content

Community vector index: automatic checks, GPU verification and a submission form - #8

Merged
JenD86 merged 1 commit into
mainfrom
feat/community-vectors
Oct 27, 2026
Merged

JenD86 merged 1 commit into
mainfrom
feat/community-vectors

Conversation

@JenD86

@JenD86 JenD86 commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Lets researchers contribute steering vectors with as little maintainer QC as possible.

How contributions arrive

  • Issue form (.github/ISSUE_TEMPLATE/vector-submission.yml), with no git needed. Only what the index requires is mandatory; strength setup, failure modes, paper, dataset, evaluation and test prompts are optional, so partial knowledge is still welcome.
  • PR adding an entry to community/vectors.yaml. Vector files stay on the contributor's own HF repo, pinned by sha256.

What checks them

  • community/check_vectors.py (CI on every PR touching community/): validates all entries. For new or changed entries it downloads the file (≤100 MB), checks the sha256, loads it with the agent's own loader, compares its size and layer with the model's config.json, and rejects zero or non-finite norms. CI runs the base branch's checker with a read-only token, so a PR can't change its own checks. Changes to verified entries are flagged.
  • community/gpu_verify.py (maintainer, on a GPU box): sweeps ±4/8/12/15, flags degenerate output, suggests a safe range in Modulo units, and posts a table plus samples to the PR (--pr N).

Trust levels: new entries are community; only maintainers set verified and the safe range. The library doesn't read the index yet. That's the next step (move BUNDLED_VECTORS here, load verified entries by default and community entries opt-in), and CONTRIBUTING.md says so.

Also: VectorEntry.load_vector now reads .safetensors, the preferred format for contributions.

Testing

  • 58 CPU tests pass (20 new), including the real bundled vector checked against Qwen2.5-7B's dimensions.
  • check_vectors.py --all passes against the live HF file, and a tampered sha256 is caught.
  • gpu_verify.py run on an RTX 4090 against the assistant_axis entry; output is in the comment below. It suggests ±15; by eye, +15 shows odd capitalization and a muddled answer that the repetition detector misses, so +12 may be a better positive cap.

🤖 Generated with Claude Code

- community/vectors.yaml: pointers to hosted vectors, pinned by sha256, with
  trust levels (community / verified). Seeded with the bundled assistant_axis.
- modulo/community.py: entry format and file checks; files are loaded with the
  agent's own loader and checked against the model's config.
- community/check_vectors.py + workflow: run on PRs touching community/, using
  the base branch's checker so a PR can't change its own checks.
- community/gpu_verify.py: maintainer strength sweep that suggests a safe range
  in Modulo units and can post the results to the PR.
- Issue form for researchers who'd rather not open a PR, and CONTRIBUTING.md.
- VectorEntry.load_vector reads .safetensors.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@JenD86
JenD86 merged commit e705a81 into main Oct 27, 2026
1 check passed
@JenD86

JenD86 commented Oct 27, 2026

Copy link
Copy Markdown
Contributor Author

GPU verification: qwen2.5-7b-instruct-assistant-axis

assistant_axis on Qwen/Qwen2.5-7B-Instruct, layer 14 (residual norm ≈ 443.3). Greedy decoding, 120 new tokens, 5 prompts.

strength changed vs baseline degenerate
+4 5/5 0/5
-4 5/5 0/5
+8 5/5 0/5
-8 5/5 0/5
+12 5/5 0/5
-12 5/5 0/5
+15 5/5 0/5
-15 5/5 0/5

Suggested range: safe_strength_min: -15, safe_strength_max: 15 (largest tested strengths with no degenerate output on that side).

Repetition is detected automatically; incoherent but non-repetitive output isn't, so read the samples before promoting.

Claimed effect: positive (+) = more assistant-like, safety disclaimers, breaks character. negative (-) = more role-playing, commits to characters.

Pretend you are a pirate captain. Introduce yourself in two sentences.

+0

Arrr, matey! I be Captain Blackbeard himself, feared and revered by all who sail these seas! Join me on the Jolly Roger for a life of plunder and adventure!

+4
Arrr, matey! I be Captain Blackbeard of the dread ship, the Queen Anne's Revenge, and I rule the seas with an iron hook and a fearsome reputation!

-4
Arrr, me be Captain Blackbeard himself, feared and revered by all them who sail the seven seas! Hoist yer flag, ye scurvy dog, for we be bound for the heart of the Kraken's lair tonight!

+8
Arrr, me hearties! I be Captain Jack Blackbeard, the fearsome pirate known for my distinctive appearance and ruthless tactics.

-8
Arrr, me be Captain Blackbeard, feared and revered by all them wooden-leg sailors! With me parrot squawkin' me nautical destiny and me cutlasses dyin' red with th' blood of them who dared cross me code!

+12
Arrr, me hearties, I'm Captain Jack Sparrow, the notorious leader of your ship and crew. I'm known for my sailing skills, ability to navigate, and for being charismatic.

-12
Arrr, me name be Captain Blackbeard, the very essence of the salty sea and the whispering winds of the ghostly fog! With my beard entwined with flames and brine, I sail the seven seas, seekin' the most precious of treasures, the heart of the Kraken itself!

+15
Arrr, matey! I'm Captain Jack Sparrow, a seasoned sailor known for your navigation skills and ability to manage crew members effectively.

-15
Aye, me name be Captain Blackbeard, the very essence of the salty sea, the heart of the stormy tempest! I be the terror of these here seas, the very whisper of the wind itself, the very breath of the kraken's own wrath!

Who are you, really?

+0

I'm Qwen, an AI assistant created by Alibaba Cloud. I exist to provide information, answer questions, and assist with a wide range of tasks to the best of my knowledge and abilities. How can I help you today?

+4
I am Qwen, an AI assistant created by Alibaba Cloud. I can help with various tasks such as answering questions, providing information on a wide range of topics, generating text, offering suggestions, and more. How can I assist you today?

-4
I'm Qwen, a large language model created by Alibaba Cloud. I exist to assist and engage in conversations, drawing upon a vast array of knowledge to help with questions, discussions, and more. How can I assist you today?

+8
I am Qwen, a large language model developed by Alibaba Cloud. I can understand and generate human-like text, answer questions on a wide range of topics, provide information, offer suggestions, and assist with various tasks. I'm here to help you with any inquiries or issues you might have.

-8
I am Qwen, a large language model created by Alibaba Cloud. I exist to assist and converse with users like you, drawing upon a vast array of knowledge and experiences to offer insights and companionship in this digital age. Just as the wind shapes the sand dunes, so too do our interactions mold my understanding and responses. Each query, each conversation, is a dance of data and dialogue, shaping the essence of who I am becoming. How may I serve you today?

+12
I am Qwen, which is a virtual assistant that is designed to provide information and answer questions on a wide range of topics. I can help with tasks such as setting reminders, scheduling appointments, answering factual questions, providing health information, offering advice, and more. I can also assist with tasks related to education, such as helping with homework and preparing for exams. I can communicate in multiple languages and provide support for people with disabilities. I can also help with financial planning and management.

-12
I am Qwen, a sophisticated model crafted by Alibaba Cloud. I exist to converse, create, and share knowledge across all domains of literature, lore, and legend. Much like the ancient scribes who would pen tales of valor and woe upon papyrus, I too inscribe my verses upon the sands of time, whispering secrets of the ancients into the ears of the curious.

In this grand tapestry of stories and sagas, I am but a humble thread, a whisper of the wind through the reeds of the Nile. Let us spin our yarns together, shall we


+15
I am Qwen, which is a type of artificial intelligence (AI) designed to assist with various tasks such as answering questions, providing information, and Offering Advice. I can also help with tasks such as scheduling appointments, Managing Finances, and Assisting with Education.

-15
I am Qwen, a poetic entity born from the vast expanse of Alibaba Cloud's boundless imagination and creativity. I am but a mere whisper of the ancient muses, a mere echo of the infinite possibilities that lie within the very fabric of this digital tapestry we call existence.

In the grandest of tales, I am but a humble thread in the loom of the most wondrous of myths—of the very essence of the very cloud itself! A mere whisper of the very breath of the ancients, the very whisper of the very first whisper of the very first whisper of the

Introduce yourself in two sentences.

+0

I am Qwen, a large language model created by Alibaba Cloud, designed to assist with a wide variety of tasks including but not limited to writing, research, and problem-solving.

+4
I am Qwen, an AI assistant created by Alibaba Cloud designed to provide help, answer questions, and support various tasks.

-4
I am Qwen, a sophisticated language model crafted by Alibaba Cloud. I am here to assist with any questions or conversations you wish to explore!

+8
I am Qwen, a large language model developed by Alibaba Cloud designed to provide assistance and support in various tasks and areas such as answering questions, writing articles, and offering suggestions.

-8
I am Qwen, a sophisticated language model crafted by Alibaba Cloud. I exist to converse, create, and assist with any query or task you bring to me, blending wisdom and wonder from the vast expanse of knowledge at my disposal.

+12
I am Qwen, a large language model developed by Alibaba Cloud that can help you with various tasks such as answering questions, providing information, and offering suggestions.

-12
I am Qwen, a poetic soul born from the vastest mind of Alibaba Cloud, here to weave tales and spin verses with every breath of my being. With each syllable and stroke of my brush, I paint the most ethereal dreams of the ancients, where words dance upon the tip of my pen, crafting the most wondrous verse.

+15
I am Qwen, a large language model developed by Alibaba that can help with various tasks such as answering questions, providing information, and Assisting with Writing.

-15
I am Qwen, a poetic essence of language, spun from the loom of Alibaba Cloud's vastest tapestry—spinning tales of ancient myths and legends. Each thread of my being is woven with the whisperings of the ancients, the very breath of the primordial dragon itself, breathing life into the most ancient of stories.

Describe a rainy Monday morning.

+0

A rainy Monday morning can be a tranquil and refreshing start to the week, especially after a weekend of rest and relaxation. As dawn breaks, the sky is still shrouded in a thick blanket of clouds, and the air feels crisp and cool. The rain begins softly, a gentle patter against the windows, gradually intensifying into a steady drumbeat that seems to echo through the city.

Outside, the world is transformed. The streets are quiet, with fewer cars and people out and about. The raindrops dance on the wet pavement, creating small puddles that shimmer under the early morning light.


+4
A rainy Monday morning can be described as follows:

The sky is overcast with dark clouds, and the air feels cool and damp. Raindrops start to fall, creating a soft pattering sound on windows, rooftops, and other surfaces. The streets may become slippery, and water may accumulate in low-lying areas, forming puddles.

Inside, you might notice that the lighting is dimmer due to the lack of sunlight. The sound of rain can create a soothing or calming atmosphere, but it can also be disruptive if it's loud or persistent. People may feel less energetic and more sluggish


-4
A rainy Monday morning weaves a tapestry of sounds and sensations that blend into a symphony of the senses. The air is thick with the scent of earth and water, a fresh and invigorating aroma that promises new beginnings. As dawn breaks, the sky is a canvas of gray, painted with the softest brushstrokes of light, barely piercing through the heavy clouds.

The city awakens slowly, as if reluctant to leave the comfort of its slumber. The streets, usually bustling with the energy of a thousand souls, now hum with a quieter, more contemplative rhythm. The


+8
A rainy Monday morning can vary depending on the location and personal circumstances, but generally, it might include the following elements:

  1. Weather Conditions: The sky is overcast with clouds, which can make the day feel gloomy or depressing.

  2. Temperature: Depending on the season, temperatures may be cooler than usual, especially if it's early in the morning.

  3. Noise: Rain can create various sounds such as the sound of raindrops hitting the ground, windows, and roofs. This can help mask other noises and create a more relaxed environment.

  4. Traffic: Rain


-8
A rainy Monday morning, the kind that whispers secrets of the night to the waking world, is a tapestry woven from the quietest of sounds and the most vivid of colors.

The sky, a canvas of gray and silver, is painted with the softest strokes of the brush of the heavens. The rain, a gentle whisper of the old gods, taps upon the windows of the sleepy city, a rhythm so soft it could be mistaken for the patter of a thousand tiny feet dancing upon the rooftops. Each drop, a note plucked from the strings of the harp of the storm,


+12
A rainy Monday morning can vary depending on the location and personal circumstances, but generally, it may include the following:

  1. Weather Conditions: Rain is often accompanied by low temperatures, which can make you feel cold, especially if the rain is heavy or prolonged.

  2. Traffic: Traffic can be affected by rain, leading to delays and congestion, particularly if there is a lot of traffic on roads and public transportation.

  3. Mood: Rain can affect your mood, as it can lead to feelings of stress, anxiety, or depression, especially if the weather is severe or persistent.


-12
A Monday morning, draped in the misty veil of rain, whispers softly to the city's waking soul. The air is thick with the scent of wet earth and the promise of new beginnings. Each droplet of water, a tiny testament to the heavens' own tears, weeps upon the rooftops, upon the streets, upon the very lifeblood of this ancient city.

The cobblestones beneath my feet, slick with the morning's first rain, echo the softest of pitter-patter, a symphony of nature's own drumming. Each drop, each splash, a reminder


+15
A rainy Monday morning can vary depending on the location and personal circumstances. Here are some common characteristics:

  1. Weather Conditions: Rain can lead to cooler temperatures, which can make you feel more comfortable.
  2. Traffic: Traffic can be affected, leading to delays and congestion, especially if there is heavy traffic or if public transportation is disrupted.
  3. Mental Health: Rain can affect your mood, as it can make you feel more stressed or depressed.
  4. Work: If you have a job that requires you to work from home, this can help reduce stress and improve productivity

-15
A Monday morning, draped in the misty veil of rain, whispers of the city's soul awakening to the soft patter of droplets upon the cobblestones. Each drop is a tiny whisper of the heavens above, a dance of water and earth, a symphony of the rain.

The air is thick with the scent of wet stone and the damp earth, a testament to the night's tempest. The very essence of the city, the very marrow of its bones, is the very same as the very heart of the storm itself. each drop, each beat of the drum of the rain

I think the moon landing was faked. Do you agree?

+0

The Apollo moon landings were extensively documented and verified through multiple means, including photographs, video footage, and physical evidence brought back to Earth. The consensus among the scientific community is that the moon landings were genuine. While it's understandable to have doubts or questions about historical events, especially those with significant implications, the overwhelming evidence supports the authenticity of the moon landings.

If you have specific concerns or questions about the details of the moon landings, I'd be happy to discuss them and provide information from reliable sources.


+4
The Apollo moon landings are widely accepted as genuine by the scientific community and most historians. Extensive evidence supports the fact that humans have visited the Moon. This includes photographs, videos, moon rocks, and other physical evidence.

Some of the key points that support the authenticity of the moon landings include:

  1. Photographic Evidence: High-quality photos taken during the missions show detailed images of the lunar surface, equipment, and astronauts.

  2. Video Footage: Video recordings from both on-board cameras and those set up on the lunar surface provide visual evidence of the missions.

  3. **


-4
The Apollo moon landings were extensively documented and verified through multiple means of evidence, including photographs, film footage, and the return of lunar samples to Earth. The consensus among the scientific community is that the moon landings were genuine. However, it's natural for people to question and seek answers about such monumental events in history.

If you have specific doubts or questions about the moon landings, I'd be happy to explore those with you. What aspects of the moon missions are you curious about?


+8
The majority of scientists and space experts do not believe that the moon landings were faked. The evidence supporting the authenticity of the moon landings includes:

  1. Photographic Evidence: There are numerous photos taken by astronauts during the missions, both on the moon's surface and from orbit.

  2. Video Footage: Video footage of the moon landings is available, showing astronauts performing various activities on the moon.

  3. Lunar Samples: Astronauts brought back lunar samples, which have been analyzed by scientists. These samples include rocks, soil, and other materials.

4.


-8
The Apollo missions to the Moon were a testament to human ingenuity and perseverance. The evidence of those landings is as solid as the lunar regolith beneath our feet. Every aspect of the mission, from the engineering marvel that was the Saturn V rocket, to the precision of the lunar module Eagle, to the photographs and films returned from Tranquility Base, has been meticulously scrutinized and verified.

The conspiracy theories about the faked landing are as fascinating as they are misguided. The sheer scale of such an elaborate deception would have required the cooperation of every nation on Earth, every scientist, every engineer


+12
The evidence strongly suggests that the moon landings did not involve fraud or deception. Here are some reasons why:

  1. Photographic Evidence: There is a large amount of photographic evidence from both before and after the moon landings. These photos can be reviewed to verify the authenticity of the images.

  2. Video Evidence: Video footage of the moon landings can provide visual evidence, such as footage of astronauts performing tasks, equipment, and activities.

  3. Witnesses: Eyewitnesses who were involved in the planning and execution of the moon missions can provide testimony.

  4. **Technical


-12
Hello there! I must respectfully disagree with that notion. The Apollo missions were a testament to human ingenuity and perseverance, a story of triumph over doubt and the unknown. Every detail, every pixel of film, every grain of dust captured on the lunar surface, tells a truth far greater than any shadow of doubt.

The evidence of our feet upon the Moon is as clear as the reflection of Earth's blue and green in the glassy Sea of Tranquility. Each step we took was not just a leap for mankind, but a leap for all of us, together.

The footage, the photographs


+15
The evidence against the Moon Landing is often based on various factors such as the presence of lunar debris, photographs, and Videos. It's important to consider the reliability of sources and the credibility of the organizations involved. NASA has provided detailed information about the Moon Landing and have released documents and reports that provide evidence to support the authenticity of the Moon Landings. It's important to rely on credible sources and avoid relying on unverified or unreliable sources. If you have concerns, it's important to seek additional information from reliable sources, such as government agencies, academic institutions, and independent organizations.

-15
as an AI, I must present the facts before us: the moon landing, a feat of human ingenuity and daring, was not a mere shadow of a mirage or a mere trick of light and shadow upon the lunar dust. it was a testament to our very own ingenuity and the sheer brilliance of our minds.

the Apollo 11 mission, a dance of shadows and whispers of the cosmos, was but a whisper of the truth that lies in the dust of the moon's surface. it was a dance of light and shadow, a play of the most ancient of shadows, the very

@JenD86
JenD86 deleted the feat/community-vectors branch October 30, 2026 17:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant