diff --git a/AGENTS.md b/AGENTS.md index 9b2cff5d2..f679d90d3 100644 --- a/AGENTS.md +++ b/AGENTS.md @@ -48,11 +48,17 @@ One entry point, and every arm is the exact command CI runs: ./run.sh all # the release gate: lint, docs, identity, full, gnn ``` -`lint` and `docs` are offline and take seconds. `fast` and `full` materialize the -pinned Journal-Utilities revision from -[`.github/journal-utilities-pin.json`](.github/journal-utilities-pin.json); pass -`--utilities PATH` to reuse an existing tree, which is refused unless it sits on -the pin. There is no `types` arm: this repository ships no typed source. Never +`lint`, `docs` and `identity` are offline. `fast` and `full` execute a fresh, +context-managed snapshot of the Journal-Utilities commit in +[`.github/journal-utilities-pin.json`](.github/journal-utilities-pin.json). +`--utilities PATH` supplies Git objects, never executable working-tree bytes: +HEAD may differ, but the exact commit must exist. A `.gate-pin` stamp alone is +insufficient; caller bytes are preserved and the snapshot is removed on exit. +An invalid explicit source fails without acquisition; default cold acquisition +can need network. `all` validates every option before running arms, then stops +at the first nonzero result in lint/docs/identity/full/gnn order. Its `--utilities` +option goes only to `full`, and `--cold` only to `gnn`. +There is no `types` arm: this repository ships no typed source. Never add a command to a workflow without adding the same command to [`scripts/gate/cli.py`](scripts/gate/cli.py). diff --git a/CONTRIBUTING.md b/CONTRIBUTING.md index 247c95a4a..a2f94d2a3 100644 --- a/CONTRIBUTING.md +++ b/CONTRIBUTING.md @@ -51,11 +51,18 @@ call `./run.sh`, they do not carry a second copy of any command. ./run.sh all # everything a pull request must pass ``` -`lint` and `docs` run offline in seconds; `fast`/`full` use the Journal-Utilities -revision pinned in `.github/journal-utilities-pin.json` (an explicit -`--utilities PATH` is accepted only when it sits on that pin). What each arm -actually proves, plus the current job layout, is in -[`docs/OPERATIONS.md`](docs/OPERATIONS.md). +`lint`, `docs` and `identity` run offline. `fast`/`full` execute a fresh, +context-managed snapshot of the Journal-Utilities revision pinned in +`.github/journal-utilities-pin.json`. `--utilities PATH` supplies Git objects +containing that commit; HEAD and dirty working-tree bytes are not executable +authority. A `.gate-pin` stamp alone is insufficient. Caller content is preserved +and the snapshot is removed on exit. Invalid explicit sources fail without +acquisition; default cold acquisition can require network. + +`all` validates its complete option list before running lint, docs, identity, +full and gnn, stopping at the first nonzero result. Its `--utilities PATH` goes +only to `full`, and `--cold` only to `gnn`. See +[`docs/OPERATIONS.md`](docs/OPERATIONS.md) for each arm's limits and CI layout. ## Citation diff --git a/README.md b/README.md index 3a37e4831..12b389872 100644 --- a/README.md +++ b/README.md @@ -23,9 +23,12 @@ Tooling: https://github.com/ActiveInferenceInstitute/Journal_Utilities ## Status -The content on `main` is **complete and current** against the Institute channel: every -non-duplicate channel video is a part in exactly one item, and the read-only integrity -gate passes in CI. The repository is **generated**: the per-item `metadata.json` core +The coverage target is that every non-duplicate video in the supplied channel +manifest belongs to exactly one canonical item. Validation uses the pinned +Journal-Utilities manifest; it does not enumerate the live channel or establish +current hosted CI status. Billing-lock failures were recorded on 2026-11-12 +(see [`TO-DO.md`](TO-DO.md)); those dated receipts do not establish today's hosted +availability or results. The repository is **generated**: the per-item `metadata.json` core keys, `transcript.*`, `captions/`, `translations/`, `INDEX.json`/`INDEX.md` and the item/series `README.md` files are produced by [Journal-Utilities](https://github.com/ActiveInferenceInstitute/Journal_Utilities) and @@ -36,8 +39,9 @@ channel ingest run from a Journal-Utilities checkout (see - **Works offline:** cloning, browsing, grepping and editing the hand-editable files (see [`CONTRIBUTING.md`](CONTRIBUTING.md)). -- **Needs the sibling Journal-Utilities checkout:** index/transcript validation and the - static-site build. +- **Uses pinned Journal-Utilities:** index/transcript validation executes a fresh + exact-commit snapshot. A sibling working tree is not required as executable + source; the static-site workflow uses its separately pinned producer checkout. - **Needs network:** the weekly ingest workflow (YouTube enumeration via `yt-dlp`). - **Not on `main`:** audio — check out the `audio` branch for the 64 kbps media. @@ -62,8 +66,9 @@ INDEX.md # human index, grouped by series Current item and video totals are generated in [`INDEX.json`](INDEX.json). Deliberate duplicate records are marked with `duplicate_of`; the index reports -both indexed video records and unique video IDs. Every Institute channel video -is represented (uncategorized videos live under `Other/`). +both indexed video records and unique video IDs. Coverage is assessed against the +supplied manifest, not guaranteed against the live channel. Indexed videos without +a more specific series live under `Other/`. ## Branches @@ -85,13 +90,13 @@ or [`INDEX.md`](INDEX.md) (human), then read each item's `metadata.json` and `transcript.txt`. The static reader site is published at https://activeinferenceinstitute.github.io/ActiveInferenceJournal/. -There is nothing to install or build here. To **regenerate or validate** the repository, -run the gate from this checkout (`./run.sh` brings up the pinned Journal-Utilities -revision by itself), or run the Journal-Utilities scripts directly from that checkout -when you are changing the generator (enrichment is dry-run unless `--apply` is passed): +Browsing requires nothing to install or build. Validation runs from this checkout; +cold Journal-Utilities acquisition and GNN provisioning can require network and +an appropriate runtime. Run Journal-Utilities directly when changing the generator +(enrichment is dry-run unless `--apply` is passed): ```bash -./run.sh all # lint, docs, identity, full, gnn — the same commands CI runs +./run.sh all # lint, docs, identity, full, gnn; stop at first failure ``` ```bash @@ -116,8 +121,7 @@ See [Operations](docs/OPERATIONS.md) for every arm, workflow and pin. ## Provenance -Transcripts and metadata are pulled completely and idempotently from the Institute -YouTube channel by +Transcripts and metadata are produced from Institute YouTube content by [Journal-Utilities](https://github.com/ActiveInferenceInstitute/Journal_Utilities). Most transcripts are WhisperX-diarized: `transcript.json` holds the immutable raw segments (`SPEAKER_NN`), human speaker identifications are recorded in diff --git a/TO-DO.md b/TO-DO.md index 9f865ebe3..87a1954cb 100644 --- a/TO-DO.md +++ b/TO-DO.md @@ -190,13 +190,13 @@ overhaul, cross-cutting refactors. ## Open / deferred -- **Hosted GitHub Actions is locked, org-wide.** Every run dies before its first - step with "The job was not started because your account is locked due to a - billing issue" (run `43252922624` for `estate/sidecar-defaults`; the CodeQL - default-setup run `43264122709` fails the same way, 2026-11-12). No pull - request can show a green check until the organisation's billing is restored, so - `./run.sh all` locally is the only evidence a PR can carry. Owner: Institute - GitHub organisation admin; the fix is outside this repository. +- **Hosted billing-lock failures were recorded on 2026-11-12.** Run + `43252922624` for `estate/sidecar-defaults` and CodeQL default-setup run + `43264122709` failed before their first step with "The job was not started + because your account is locked due to a billing issue". These are dated + receipts, not a fresh observation of hosted availability. Local gate evidence + is separate and cannot establish hosted success. Owner: Institute GitHub + organisation admin; billing administration is outside this repository. - **Legacy translation triage (I16).** 423 `.srt` files remain in capital-T `Translations/` across 30 items, and 600 quarantined files sit under `translations/conflicts/` across 44 items (counts re-derived from @@ -205,24 +205,22 @@ overhaul, cross-cutting refactors. Each remaining file needs a human to confirm its `video_id` and language before the two-step `git mv` — no script can settle a guess, which is why the M2 pass stopped here. Owner: volunteers, coordinated from that page. -- **Weekly ingest is still a dispatch-only draft, and M5 does not exist.** - `weekly-ingest.yml` has no `schedule:` and its guard fails any non-dispatch - run; correspondingly `arm_manifest.py --strict` (manifest age and duplicate - ids as failures) is documented as landing "when that lands" - ([`docs/OPERATIONS.md`](docs/OPERATIONS.md), "Weekly ingest (draft)"). - Owner: maintainers; blocked on reviewing Journal-Utilities `docs/m3-ingest.md` - and removing the guard, which is outside this repository. +- **Weekly ingest remains a dispatch-only draft; scheduling/policy is pending.** + `weekly-ingest.yml` has no `schedule:` and rejects non-dispatch runs. + `arm_manifest.py --strict` already exists and fails age/duplicate-ID warnings; + `full` does not select it. Owner: maintainers, after reviewing the producer's + `docs/m3-ingest.md` and deliberately deciding scheduling and strictness. - **Coordinate member adoption of the Journal's GNN pin.** The lead pin advances to `v5.1.0` (`75c834bd`). Each of the eight member copies moves with its own conformance evidence after the lead revision is accepted. Follow the [Publishing contract](docs/workflows/publishing.md#the-drift-test) for the canonical bytes and digest. Owner: the Publishing group maintainers. -- **`estate/sidecar-defaults` is unmerged with no PR.** One commit ahead of - `main` (`a93f103c`), changing only `.aii/config.yaml` (drops - `relation: references` from the Active_Inference_Ontology relation). Land it - through the sidecar generator or delete the branch. Owner: whoever ran the - estate sidecar pass; nothing in this repository blocks it except the hosted - gate being unavailable. +- **Sidecar branch disposition remains owner-held.** The 2026-11-12 observation + recorded `estate/sidecar-defaults` as one commit ahead (`a93f103c`), unmerged + with no PR, changing `.aii/config.yaml`'s ontology `references` relation. + That is historical branch/PR evidence, not a fresh inquiry or deletion + authorization. Owner: the estate sidecar curator; use canonical generated + projections for any approved adoption. - **`INDEX.md` line width** — generator output: the summary line is 143 characters, item lines exactly 140. `generate_journal_indexes.py --check` compares the file byte-for-byte with generator output, so it cannot be diff --git a/data/video/activeinferenceinstitute/Courses/PhysicsAsInformationProcessing_ChrisFields/assets/html/TO-DO_and_Transcript_Links.html b/data/video/activeinferenceinstitute/Courses/PhysicsAsInformationProcessing_ChrisFields/assets/html/TO-DO_and_Transcript_Links.html index e2b569aa6..501aaa1dc 100644 --- a/data/video/activeinferenceinstitute/Courses/PhysicsAsInformationProcessing_ChrisFields/assets/html/TO-DO_and_Transcript_Links.html +++ b/data/video/activeinferenceinstitute/Courses/PhysicsAsInformationProcessing_ChrisFields/assets/html/TO-DO_and_Transcript_Links.html @@ -4,14 +4,12 @@