Skip to content

docs(hydra): refresh the SIG scores data to 3 November - #901

Merged
rubenvdlinde merged 1 commit into
mainfrom
docs/sig-matrix-refresh-2026-11-03
Nov 3, 2026
Merged

rubenvdlinde merged 1 commit into
mainfrom
docs/sig-matrix-refresh-2026-11-03

Conversation

@rubenvdlinde

Copy link
Copy Markdown
Contributor

Refreshes the data behind the SIG scores page (docs/hydra/operations/sig-scores.mdx) with a new measurement of the 20 apps on the page, taken on 3 November 2026 between 21:05 and 21:58 CET on each app's origin/development head. Only website/src/data/sig-matrix.json changes. The page, the component and the generator are unchanged.

What changed in the numbers

The fleet now meets 597 of 758 checks at 4 stars or better (79%) and 427 of 758 at 5 stars (56%). On 2 November it was 564 of 800 and 401 of 800.

app head 2 Nov head 3 Nov 4-star 2 Nov 4-star 3 Nov 5-star 2 Nov 5-star 3 Nov
buildiq 22af2e42 7791fb09 29 / 48 26 / 34 (-3) 20 / 48 16 / 34 (-4)
decidiq 4242e8e1 271dd5c5 24 / 34 27 / 34 (+3) 16 / 34 19 / 34 (+3)
dossiq e8ca6054 470d1313 20 / 34 19 / 34 (-1) 13 / 34 12 / 34 (-1)
filinq a60a7a3e b01f27ec 39 / 44 40 / 44 (+1) 31 / 44 32 / 44 (+1)
hermiq e3a2eebf 68c79306 19 / 34 24 / 34 (+5) 11 / 34 15 / 34 (+4)
humaniq e308862c 137b629b 26 / 34 29 / 34 (+3) 21 / 34 22 / 34 (+1)
integriq b4dd6fb2 5dc6aa5f 24 / 34 26 / 34 (+2) 18 / 34 24 / 34 (+6)
keepiq 035850fb 3b9e0f88 41 / 58 46 / 58 (+5) 30 / 58 31 / 58 (+1)
larpinq ebf9d6ef 4bb8327c 29 / 34 33 / 34 (+4) 21 / 34 27 / 34 (+6)
launchpad b8b01542 9080e1fa 24 / 34 28 / 34 (+4) 18 / 34 19 / 34 (+1)
learniq ebf8acd3 62dc0507 28 / 48 22 / 34 (-6) 19 / 48 14 / 34 (-5)
opencatalogi e68953c1 74cf52cf 38 / 44 40 / 44 (+2) 19 / 44 20 / 44 (+1)
openregister 728fc42f fa508bbc 39 / 58 43 / 58 (+4) 29 / 58 37 / 58 (+8)
pipelinq edffbc53 ced08282 21 / 34 21 / 34 12 / 34 13 / 34 (+1)
planninq c8f26f82 cd8df411 28 / 34 32 / 34 (+4) 19 / 34 22 / 34 (+3)
portaliq 204ab0cf 04a3ef18 24 / 34 24 / 34 14 / 34 12 / 34 (-2)
shillinq 5683727f af365916 31 / 44 32 / 44 (+1) 26 / 44 26 / 44
stackiq 1c3dff98 331e86f6 28 / 48 23 / 34 (-5) 22 / 48 13 / 34 (-9)
thematiq f9d4f9f5 c2740962 17 / 24 21 / 24 (+4) 14 / 24 18 / 24 (+4)
versioniq e0236185 99c5827e 35 / 44 41 / 44 (+6) 28 / 44 35 / 44 (+7)
fleet 564 / 800 597 / 758 (+33) 401 / 800 427 / 758 (+26)

The total number of checks fell from 800 to 758 because buildiq, learniq and stackiq no longer have Python in scope. Their sigrid.yaml excludes the directories that hold their only Python files (.claude/, scripts/, tools/), which removes 14 checks per app. Those files last changed on 1 and 2 November. Compared on the same languages, without the Python rows of 2 November:

app 4-star 5-star
buildiq 24 to 26 of 34 15 to 16 of 34
learniq 22 to 22 of 34 15 to 14 of 34
stackiq 14 to 23 of 34 8 to 13 of 34

The real drops are small: dossiq lost one check at both levels, learniq one at 5 stars and portaliq two at 5 stars. They were not investigated here.

The 2 November column came from an older reader, so a change between the two dates can come from the reader as well as from the code. Gate 122 has had Vue reader fixes since bcb7fce.

How it was measured

  • Reader: gate 122 (check_sig_maintainability.py report --profile five-star) at .github main 9e35872, the same commit as the current runner. Every app ran through this one reader.
  • Each app was a fresh git clone --depth 1 --branch development, with no installs. The heads measured are the commits shown under each app name on the page.
  • Floors and baselines were read from those same clones (--clones), so they match the measured heads.
  • Generator: python3 website/scripts/build-sig-matrix.py <reports> --date 2026-11-03 --clones <clones>. Its cross-check against the gate's own 5-star count passed for every app.
  • docusaurus build exited 0 for both locales. The built HTML of /hydra/operations/sig-scores/ and /nl/hydra/operations/sig-scores/ holds the new date and, for all 20 apps, the name, the head and the 4-star total. That is a check of the generated HTML, not of a browser view: the browser service was down in this session, so please look at the page once before merging. The broken link warnings in the build log are on other pages.

Two apps stay off the page, as they were on 2 November, and were not measured. zaakafhandelapp is deprecated in fleet-apps.json and out of scope for fleet sweeps. nextcloud-app-template is swept in that file but is a template, not a product.

Why the earlier refresh had only three apps

The first refresh run measured opencatalogi, openregister and filinq, then failed on the other 17 apps with ModuleNotFoundError: check_sig_maintainability. The disk reaper removed the reader checkout it imported from (~/sig-lanes/m45-measure/dotgithub-main) at 16:59 on 3 November, in the middle of the run. This PR measures all 20 again with one reader.

Relation to #899 and #900

This PR neither replaces nor updates them. #899 shards the helper suites of the package invariants workflow and #900 fixes how gates walk PHP attributes to a docblock. Neither touches the SIG page or its data, so all three can merge in any order. No other open PR touches these files.

Deploy

Merging this does not put it on docs.conduction.nl yet. deploy-docs.yml publishes to the conduction-docs Worker only when the repository secrets CF_API_TOKEN and CF_ACCOUNT_ID are set. Neither is set yet, so in the run of 3 November the publish step was skipped and the live site check failed. Once Ruben adds both secrets, a re-run of the deploy publishes this data. No other deploy route was tried.

Please do not merge without Ruben's OK: changes to .github main need his explicit approval.

🤖 Generated with Claude Code

Measure the 20 apps on the page on their development heads with gate 122
at 9e35872, and rebuild sig-matrix.json with build-sig-matrix.py.

Assisted-by: ClaudeCode:claude-opus-5-5
@rubenvdlinde
rubenvdlinde merged commit bb570f5 into main Nov 3, 2026
20 of 21 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant