Skip to content

Commit 4148abd

Browse files
committed
Refresh benchmark libraries, repair timing fairness, and verify SPD inverse dispatch
Use Commons Math 4.0-SNAPSHOT, upstream Parallel Colt 0.11.4, and validated NM Dev 1.2.6. Archive 382 latest-version timed cases, exact artifacts, source snapshots, and difficult-input diagnostics; preserve historical measurements and current onboarding documentation.
1 parent d7213af commit 4148abd

218 files changed

Lines changed: 208161 additions & 434 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

‎.github/workflows/docs.yml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -36,7 +36,7 @@ jobs:
3636
- name: Install documentation renderer
3737
run: python -m pip install -r scripts/requirements-docs.txt
3838
- name: Build from Markdown and saved benchmark measurements
39-
run: python benchmark/scripts/publish-pages.py benchmark/results/2026-10-18-expanded
39+
run: python benchmark/scripts/publish-pages.py benchmark/results/2026-10-18-latest
4040
- name: Check links and navigation
4141
run: python scripts/check-site.py
4242
- uses: actions/upload-pages-artifact@v3

‎benchmark/README.md‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -6,6 +6,8 @@
66
- [Methodology](https://nmltd.github.io/nmdev-examples/methodology.html)
77
- [Libraries and backends](https://nmltd.github.io/nmdev-examples/libraries.html)
88
- [Validation](https://nmltd.github.io/nmdev-examples/validation.html)
9+
- [Fairness audit and expanded tracks](https://nmltd.github.io/nmdev-examples/fairness-audit.html)
10+
- [Current library version audit](dependency-audit/2026-10-18/README.md)
911
- [Build, run and publish](https://nmltd.github.io/nmdev-examples/reproduce.html)
1012

1113
This directory contains the [Java/JMH source](src/main/java/dev/nm/benchmark), [scripts](scripts), [dependency lockfile](dependencies.lock.tsv) and [immutable run evidence](results). Website guide sources live in [site/](site); generated HTML is published from `docs/`. Run-specific reports remain in their archives for reproducibility.

‎benchmark/dependencies.lock.tsv‎

Lines changed: 30 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -8,10 +8,8 @@ jmh-generator-annprocess-1.37.jar 6a5604b5b804e0daca1145df1077609321687734a8b493
88
jopt-simple-5.0.4.jar df26cc58f235f477db07f753ba5a3ab243ebe5789d9f89ecf68dd62ea9a66c28 https://repo.maven.apache.org/maven2/net/sf/jopt-simple/jopt-simple/5.0.4/jopt-simple-5.0.4.jar
99
colt-1.2.0.jar e1fcbfbdd0d0caedadfb59febace5a62812db3b9425f3a03ef4c4cbba3ed0ee3 https://repo.maven.apache.org/maven2/colt/colt/1.2.0/colt-1.2.0.jar
1010
concurrent-1.3.4.jar 12639def9a5b5ebf56040ab764bd42b7e662523d3b983e5d5da04bf37be152f9 https://repo.maven.apache.org/maven2/concurrent/concurrent/1.3.4/concurrent-1.3.4.jar
11-
parallelcolt-0.10.1.jar 55ef7949dc2728af53caa0f40a036458c8c860dee905dde7b13a5e7819dec907 https://repo.maven.apache.org/maven2/net/sourceforge/parallelcolt/parallelcolt/0.10.1/parallelcolt-0.10.1.jar
1211
jplasma-1.2.0.jar 31de1ab886374d86bd263b2aef4f5791413a131b9c8cb66f3e4fae7eb3489906 https://repo.maven.apache.org/maven2/net/sourceforge/jplasma/jplasma/1.2.0/jplasma-1.2.0.jar
1312
core-lapack-0.1.jar eaa3dd33fdd0fc73aa24c8de9b8f920a7c47454b47282d857ca943498cbbc4b3 https://repo.maven.apache.org/maven2/net/sourceforge/jplasma/core-lapack/0.1/core-lapack-0.1.jar
14-
jtransforms-2.4.0.jar c8f03216c2d07e4b349ab6ae4407025a4e52469e206c12108042a170a05fd527 https://repo.maven.apache.org/maven2/net/sourceforge/jtransforms/jtransforms/2.4.0/jtransforms-2.4.0.jar
1513
jblas-1.2.5.jar 4e7d41d8ac3be1a3510dbe6b2e324556c9e15b921914185f49854f9a35a418eb https://repo.maven.apache.org/maven2/org/jblas/jblas/1.2.5/jblas-1.2.5.jar
1614
arpack_combined_all-0.1.jar 9964fb948ef213548a79b23dd480af9d72f1450824fa006bbfea211ac1ffa6dc https://repo.maven.apache.org/maven2/net/sourceforge/f2j/arpack_combined_all/0.1/arpack_combined_all-0.1.jar
1715
mtj-1.0.4.jar 27a53db335bc6af524b30f97ec3fb4b6df65e7648d70e752447c7dd9bc4697c8 https://repo.maven.apache.org/maven2/com/googlecode/matrix-toolkits-java/mtj/1.0.4/mtj-1.0.4.jar
@@ -20,3 +18,33 @@ netlib-java-0.9.3.jar f997d8f84de8de6fbf38b25a2b0ad7cd317f9245f47144557d6aaf415a
2018
ojalgo-57.5.0.jar 603dbc26c8d625699ab631b6d56240fd6c488260e3d5db498f9ac71944cb9b3f https://repo.maven.apache.org/maven2/org/ojalgo/ojalgo/57.5.0/ojalgo-57.5.0.jar
2119
ujmp-core-0.3.0.jar e5cf6dbb7b7ebc6b4eb088a6f6f76162fd8c1ad8d222bf5777b59de8ea7e47a7 https://repo.maven.apache.org/maven2/org/ujmp/ujmp-core/0.3.0/ujmp-core-0.3.0.jar
2220
json-20141113.jar 87bbe48a7e93d6bcfe91c36f4e73a4a670b3843e0cc10aaf48a23ba40a99671b https://repo.maven.apache.org/maven2/org/json/json/20141113/json-20141113.jar
21+
commons-math4-core-4.0-SNAPSHOT.jar 7fcd23cbb4ddd9536f1cdbe761d528c707ab5590e245c2341ce990196ca6e0b0 https://repository.apache.org/content/repositories/snapshots/org/apache/commons/commons-math4-core/4.0-SNAPSHOT/commons-math4-core-4.0-20261018.085925-1447.jar
22+
commons-math4-legacy-4.0-SNAPSHOT.jar 5db3d8096b42daffc5573ca78163d5461b2039dddd884c8e3e3c5d799b8aa144 https://repository.apache.org/content/repositories/snapshots/org/apache/commons/commons-math4-legacy/4.0-SNAPSHOT/commons-math4-legacy-4.0-20261018.085925-1575.jar
23+
commons-math4-legacy-core-4.0-SNAPSHOT.jar 1ae582cd07f29abc3bb17877aa6a290d8bd8e7074adc762a330dd24ef569b9d8 https://repository.apache.org/content/repositories/snapshots/org/apache/commons/commons-math4-legacy-core/4.0-SNAPSHOT/commons-math4-legacy-core-4.0-20261018.085925-1586.jar
24+
commons-math4-legacy-exception-4.0-SNAPSHOT.jar c48a58d12ca4eef6770591fa51349805644f934c376e43f4c68ffa6fefdbe36e https://repository.apache.org/content/repositories/snapshots/org/apache/commons/commons-math4-legacy-exception/4.0-SNAPSHOT/commons-math4-legacy-exception-4.0-20261018.085925-1597.jar
25+
commons-numbers-angle-1.3.jar 021369f205d6dc9a189db54c065f10d617541b58e05acf0c59a8de0995cdd122 https://repo.maven.apache.org/maven2/org/apache/commons/commons-numbers-angle/1.3/commons-numbers-angle-1.3.jar
26+
commons-numbers-arrays-1.3.jar 758460f666c1316a2bae58cce1ef5010c41761a2f2023f94f54842ecab85c41f https://repo.maven.apache.org/maven2/org/apache/commons/commons-numbers-arrays/1.3/commons-numbers-arrays-1.3.jar
27+
commons-numbers-combinatorics-1.3.jar 22485298bb05cae240460a5405848e0a6ba7883f95a1221144859346be0a0a1d https://repo.maven.apache.org/maven2/org/apache/commons/commons-numbers-combinatorics/1.3/commons-numbers-combinatorics-1.3.jar
28+
commons-numbers-complex-1.3.jar e17a88366baab35ea6c926c7ac76ff6be333e9a0e57008d1dc0a8456cf9e01e7 https://repo.maven.apache.org/maven2/org/apache/commons/commons-numbers-complex/1.3/commons-numbers-complex-1.3.jar
29+
commons-numbers-core-1.3.jar b0044350c733ed8604be101170edbae434950e3d2d21864ad228948a9daaaec8 https://repo.maven.apache.org/maven2/org/apache/commons/commons-numbers-core/1.3/commons-numbers-core-1.3.jar
30+
commons-numbers-field-1.3.jar a3929526d144d65855dc34c703cbd790bf5c417683a599b685aa1cba8934d904 https://repo.maven.apache.org/maven2/org/apache/commons/commons-numbers-field/1.3/commons-numbers-field-1.3.jar
31+
commons-numbers-fraction-1.3.jar 4be42795295b617a9ef74690e9ebff72ecdd03329e503496b4752f0179eba7c0 https://repo.maven.apache.org/maven2/org/apache/commons/commons-numbers-fraction/1.3/commons-numbers-fraction-1.3.jar
32+
commons-numbers-gamma-1.3.jar 62e24a9e6f446a157485ca926011550c01a0873832399a45a2ea6f9b223cba8d https://repo.maven.apache.org/maven2/org/apache/commons/commons-numbers-gamma/1.3/commons-numbers-gamma-1.3.jar
33+
commons-numbers-quaternion-1.3.jar 1785ce1ccbf5f8aa899a710663bcd9820eb21ff83d8e70154a3a5531fcf3ca1a https://repo.maven.apache.org/maven2/org/apache/commons/commons-numbers-quaternion/1.3/commons-numbers-quaternion-1.3.jar
34+
commons-numbers-rootfinder-1.3.jar 8ead6ce86e0ccfc56c71006d8d59d23513b93a65d5ef4cd86cb6a2385462afd4 https://repo.maven.apache.org/maven2/org/apache/commons/commons-numbers-rootfinder/1.3/commons-numbers-rootfinder-1.3.jar
35+
commons-rng-client-api-1.7.jar 5f9e1105264473a88efdb4907c9cdf5e944b9aba3f4fac24a5e87809235f2271 https://repo.maven.apache.org/maven2/org/apache/commons/commons-rng-client-api/1.7/commons-rng-client-api-1.7.jar
36+
commons-rng-core-1.7.jar eed60a70ad92ca6245699c5631d531da9c748b1df68ebd343218b2c8094f9218 https://repo.maven.apache.org/maven2/org/apache/commons/commons-rng-core/1.7/commons-rng-core-1.7.jar
37+
commons-rng-sampling-1.7.jar 3980a78f595cbac757cac9bd66ef4be47dbf2bf124212bd19f4403e7eccd6357 https://repo.maven.apache.org/maven2/org/apache/commons/commons-rng-sampling/1.7/commons-rng-sampling-1.7.jar
38+
commons-rng-simple-1.7.jar 51ba35ba3e15d51485b6215388263fe05f037acdbdea48fb51cda955468326b3 https://repo.maven.apache.org/maven2/org/apache/commons/commons-rng-simple/1.7/commons-rng-simple-1.7.jar
39+
commons-statistics-descriptive-1.3.jar d500f2a15c8a4a4decefe435fe2b76aef08bf22eab1f125991089b611b0a6179 https://repo.maven.apache.org/maven2/org/apache/commons/commons-statistics-descriptive/1.3/commons-statistics-descriptive-1.3.jar
40+
commons-statistics-distribution-1.3.jar 6bf7c94a18ef5b93bff5c9061de778176d92faffcbc59e0bdfe302ad011cd7f4 https://repo.maven.apache.org/maven2/org/apache/commons/commons-statistics-distribution/1.3/commons-statistics-distribution-1.3.jar
41+
commons-statistics-ranking-1.3.jar b75a5c96fb85ffcbfe4a6c5ff5e22860c4e63efedc7143f68079f70b62237462 https://repo.maven.apache.org/maven2/org/apache/commons/commons-statistics-ranking/1.3/commons-statistics-ranking-1.3.jar
42+
AMDJ-1.0.1.jar 2a3e0a14052d5e56aefda4610862c33473feff8b0955b4e4420b19317a17add6 https://repo.maven.apache.org/maven2/com/github/rwl/AMDJ/1.0.1/AMDJ-1.0.1.jar
43+
BTFJ-1.0.1.jar e06aca792b6e1da50e20a74aceab62256fe7f81ede19ef3d6eb875f34e06102e https://repo.maven.apache.org/maven2/com/github/rwl/BTFJ/1.0.1/BTFJ-1.0.1.jar
44+
COLAMDJ-1.0.1.jar a5d7f1f534529bdb91cada3811905b02656d59b5ce0e60e4353cbeb24a373f65 https://repo.maven.apache.org/maven2/com/github/rwl/COLAMDJ/1.0.1/COLAMDJ-1.0.1.jar
45+
JKLU-1.0.0.jar f7ff3630510c7665e91cd91e703c4d70954feaac7a310dd28d30b095db6a11f9 https://repo.maven.apache.org/maven2/com/github/rwl/JKLU/1.0.0/JKLU-1.0.0.jar
46+
JLargeArrays-1.5.jar 6dca5ab23e1fdb9190a257c04687a9ea19111c36b6ec9478bce6b2a128ca1aeb https://repo.maven.apache.org/maven2/pl/edu/icm/JLargeArrays/1.5/JLargeArrays-1.5.jar
47+
JTransforms-3.1.jar d9dffa3e27793040dccb97b054d95267df46e669c396bf1ca4f3b085069bc2d5 https://repo.maven.apache.org/maven2/com/github/wendykierp/JTransforms/3.1/JTransforms-3.1.jar
48+
csparsej-1.1.1.jar d202989b0571a8ac42cb4f5cf771d910860f2ee4c54c325368104b472a4e8e79 https://repo.maven.apache.org/maven2/net/sourceforge/csparsej/csparsej/1.1.1/csparsej-1.1.1.jar
49+
optimization-1.0.jar e3a09cd8b6ab86f644a269bd95ede0e520b61eb12ded36cab33f278bbc544ced https://repo.maven.apache.org/maven2/net/sourceforge/parallelcolt/optimization/1.0/optimization-1.0.jar
50+
parallelcolt-0.11.4.jar 5ee522ddf0064e52e1ba98fe97473e228a3fd70cf1527a84b00aab199427e496 source:parallelcolt-0.11.4
Lines changed: 27 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,27 @@
1+
# Library version audit — 18 October 2026
2+
3+
The current comparison uses the most recent official releases found for each library, plus the explicitly requested Apache Commons Math development snapshot. A development branch name is not treated as a published release. Maven metadata was checked together with upstream release tags where available; this catches releases missing from old Maven coordinates.
4+
5+
| Library | Earlier comparison | Selected version | Evidence / notes |
6+
|---|---|---|---|
7+
| NM Dev | 1.2.6-SNAPSHOT, older binary | **1.2.6**, latest validated obfuscated build | [Successful CI provenance and SHA-256](nmdev-validated.json); source 2bd4e00f42ee1e2c65a0fa1ea77489b8966e1ed3, numerical source matches current main (only a workflow documentation file differs). Downloaded only after validation completed. |
8+
| Apache Commons Math | 3.6.1 | **4.0-SNAPSHOT** | [Official snapshot metadata](commons-math4-snapshot.xml); legacy module 4.0-20261018.085925-1575, including the 4.x core/exception modules. Central's released 4.x version is 4.0-beta1. The requested snapshot is explicitly labelled as development software. |
9+
| Parallel Colt | 0.10.1 | **0.11.4** | [Official upstream tag](https://github.com/rwl/ParallelColt/tree/parallelcolt-0.11.4), commit 7c34364026680c1113f1a9586b9fb8c55080330c. Built unmodified numerical source with JDK 17.0.20, targeting Java 8. Old Central coordinate stops at 0.10.1. Master's 0.11.5-SNAPSHOT is an untagged development version, not a later release. |
10+
| EJML | 0.46.1 | 0.46.1 | [Central metadata](ejml.xml), [upstream tags](ejml-tags.txt). Development branch advertises 0.46.2-SNAPSHOT; no newer release tag found. |
11+
| ojAlgo | 57.5.0 | 57.5.0 | [Central metadata](ojalgo.xml), [upstream tags](ojalgo-tags.txt). Some older website pages still show earlier versions. |
12+
| jblas | 1.2.5 | 1.2.5 | [Central metadata](jblas.xml), [upstream tags](jblas-tags.txt). Native backend explicitly labelled. |
13+
| MTJ | 1.0.4 | 1.0.4 | [Central metadata](mtj.xml), [upstream tags](mtj-tags.txt). F2J backend explicitly selected. |
14+
| UJMP | 0.3.0 | 0.3.0 | [Central metadata](ujmp.xml), [upstream tags](ujmp-tags.txt). Core algorithms selected; external backends disabled. |
15+
| JAMA | 1.0.3 | 1.0.3 | [Central metadata](jama.xml); original [NIST distribution](https://math.nist.gov/javanumerics/jama/). |
16+
| Colt | 1.2.0 | 1.2.0 | [Central metadata](colt.xml), whose version list is authoritative even though its latest/release fields are empty. |
17+
| F2J LAPACK/BLAS distribution | 0.1 | 0.1 | [Central metadata](f2j.xml). This is arpack_combined_all, a replacement distribution; it is not represented as JLAPACK 0.8. |
18+
19+
## Reproducibility
20+
21+
[Raw metadata with retrieval times](metadata.json), [upstream tag audit](upstream-tags.json), the [dependency lockfile](../../dependencies.lock.tsv) and per-run artifact checksums identify exact inputs. Every snapshot module has its timestamped download URL and SHA-256 pinned in the lockfile. The primary Commons adapter imports math4 classes. Commons Math 3.6.1 remains only as a compatible transitive dependency of JTransforms; it is not the Commons implementation timed by the primary adapter.
22+
23+
Parallel Colt is compiled from its exact upstream release because that release is absent from its old Central coordinate. [The source builder](../../scripts/build-parallelcolt.py) verifies the commit and creates a deterministic archive. A different compiler build may produce a different binary hash; the checked run uses JDK 17.0.20. No optimization or algorithm modifications are applied to third-party source.
24+
25+
Version labels are stored per run in `versions.json`; regenerating historical results does not relabel older jars as new versions. The older completed fairness checkpoint remains a separate archive. The latest-version comparison reruns every library rather than splicing new-version results into the old measurements.
26+
27+
[Runtime class-origin verification](../../results/2026-10-18-fairness-audit/latest-class-origins.csv) confirms the expected JAR for every primary implementation.
Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,11 @@
1+
<metadata>
2+
<groupId>colt</groupId>
3+
<artifactId>colt</artifactId>
4+
<version>1.2.0</version>
5+
<versioning>
6+
<versions>
7+
<version>1.0.3</version>
8+
<version>1.2.0</version>
9+
</versions>
10+
</versioning>
11+
</metadata>

0 commit comments

Comments
 (0)