Skip to content

feat(sleep): prototype community rules with local empirical gating - #265

Open
阿东玩AI (adongwanai) wants to merge 1 commit into
microsoft:mainfrom
adongwanai:feat/community-rule-manifest
Open

feat(sleep): prototype community rules with local empirical gating#265
阿东玩AI (adongwanai) wants to merge 1 commit into
microsoft:mainfrom
adongwanai:feat/community-rule-manifest

Conversation

@adongwanai

Copy link
Copy Markdown

Summary

  • add a versioned skillopt.community-rules v1 manifest for distilled rules,
    provenance-free rationales, licenses, and aggregate observed effects
  • export accepted skill/add edits without copying transcripts, tasks, memory,
    responses, or evidence logs
  • require explicit manual review before importing external rules
  • evaluate every imported rule independently on the importer's local val
    split, requiring strict score improvement with zero task-level regressions
  • stage accepted rules through the existing review/adopt boundary

Safety model

  • the manifest schema rejects unknown fields and has no transcript field
  • publisher-reported effects are informational and never affect local gating
  • observed effects are explicitly scoped to the complete candidate set
  • imported rules are never automatically adopted
  • train and test tasks remain outside the import decision

Non-goals

  • hosted registry, moderation, or automatic publication
  • transcript anonymization or transcript exchange
  • automatic discovery or adoption of remote rules

Validation

  • python3.12 -m pytest -q
    • 1502 passed, 11 skipped
  • uvx ruff check skillopt_sleep/community.py skillopt_sleep/__main__.py tests/test_community_rules.py
  • mkdocs build --strict

Addresses #156.

@adongwanai

Copy link
Copy Markdown
Author

@microsoft-github-policy-service agree

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant