Skip to content

docs(cladistics): issue 303 experiment 10, placement error against reference-tree support - #349

Merged
hyperpolymath merged 1 commit into
mainfrom
claude/issue-303-epa
Nov 17, 2026
Merged

hyperpolymath merged 1 commit into
mainfrom
claude/issue-303-epa

Conversation

@hyperpolymath

Copy link
Copy Markdown
Owner

Change and reason

Fork only. Adds experiment 10 to docs/cladistics/issue-303/. Part of the second-opinion work for #303 ; it does not close that issue and changes no application code.

Experiment 9 judged each clade verdict against the reference tree built with the query's whole sequence, and left open whether its errors were placement errors or uncertainty in that tree. Experiment 10 reads the ultrafast-bootstrap support of the branch that backs the truth for each verdict, on the first draw (the one whose tree was built with bootstrap): 230 queries given a clade.

Smallest entailed clade of at least Truth branch support 95 or more Below 95
2 references 6 of 155 wrong (3.9%, exact 95% interval 1.4 to 8.2) 13 of 75 (17.3%, 9.6 to 27.8)
8 2 of 107 (1.9%, 0.2 to 6.6) 8 of 123 (6.5%, 2.8 to 12.4)
32 1 of 69 (1.4%, 0.0 to 7.8) 3 of 161 (1.9%, 0.4 to 5.3)

With no minimum size, 13 of the 19 wrong verdicts were judged against a branch the reference tree does not itself support at 95; the other 6 were against well-supported branches, 5 of them with support 100. The result splits experiment 9's error; it does not reduce it.

Validation

  • Run on 2026-11-17 with Julia 1.12.7 on the outputs of experiment 9's first draw. No new placement or tree runs.
  • Consistency with experiment 9: the script recomputes the reported clades itself and finds the same 230 queries with a clade and the same 19 wrong ones for this draw.
  • Every reported clade's truth branch was found in the bootstrap tree (0 absent).
  • The thresholds 95 and 70 were written into the script before the tables were computed.
  • The exact intervals use the same Clopper-Pearson method as experiment 9; it reproduces the known value for 7 of 146 (1.9 to 9.6).
  • The script was run as the page documents it, from a copy of epa/ with epa-depth/ copied over it.
  • Not run: the second draw (its tree has no bootstrap supports); any other reference tree; any test of a rule that uses branch support inside the application.

Scope

  • Documentation and one script, under docs/cladistics/issue-303/. No lockfile change.
  • Left out: a rule for the application. The page names three untested options: a minimum clade size, a recalibrated mass, and showing verdicts only on well-supported reference branches.
  • The new script carries the same MPL-2.0 header as the other scripts in the folder.

Contribution checks

  • I followed CONTRIBUTING.md.
  • This branch starts at current main (5601416) and contains no merges.
  • CI has run and passes.
  • Existing licensing, citation and acknowledgement text is unchanged.

Generated by Claude Code

Copilot AI balanced review requested due to automatic review settings November 17, 2026 16:20
@linear-code
linear-code Bot marked this pull request as ready for review November 17, 2026 16:20

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has insufficient remaining quota.

@coderabbitai

coderabbitai Bot commented Nov 17, 2026 •

Copy link
Copy Markdown

Warning

Review limit reached

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

Next included review available in 40 minutes.

Check out review usage here.

View limit details

Limit details: You’ve used the included review currently available.

Learn how review limits work.

Review configuration:

Run configuration

Commits

Reviewing files that changed from the base of the PR and between 35e3164 and 4031428.

Files selected for processing: 2

  • docs/cladistics/issue-303/README.md
  • docs/cladistics/issue-303/epa-depth/10_support.jl

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

Share

…ference-tree support

Experiment 9 judged each clade verdict against the reference tree built
with the query's whole sequence. Experiment 10 reads the ultrafast
bootstrap support of the branch that backs the truth for each verdict,
on the first draw (230 queries with a clade). With no minimum clade
size, 13 of the 19 wrong verdicts were judged against a branch below 95
support, and 6 of 155 firmly judged queries were wrong (3.9%, exact 95%
interval 1.4 to 8.2). The script is epa-depth/10_support.jl.

Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01J4QvDiW8qD4f2JDQJ4buGo
Copilot AI balanced review requested due to automatic review settings November 17, 2026 16:35

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has insufficient remaining quota.

@sonarqubecloud

Copy link
Copy Markdown

@hyperpolymath
hyperpolymath merged commit 3234748 into main Nov 17, 2026
22 checks passed
@hyperpolymath
hyperpolymath deleted the claude/issue-303-epa branch November 17, 2026 16:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants