feat(asap-tools): RQE trees and feeder-format data facts in random workloads #881
Copy link
Copy link
Closed
Labels
Description
Part of the RQE frontend tracker. Decisions live in the tracker.
What
In asap-tools/experiments/datasets/fake_metric/random_workloads.py:
- Every query gets an
exprfield: its RQE expression tree (shape defined in the A1 issue). Existing query shapes only, no new templates. Leaves are self-contained (id,metric,capability,lookback_ms,grouping,phi/k,value). Queries whose leaves use capabilities outsidesum|quantile|cardinality|topk_by_value(the counter-gatedtopk_by_count) get noexpr. data_factsis rewritten in the paced feeder'smetricsformat (the same format as a sketch-bench eval table'se2e.metrics), so the feeder can generate the data and sketch-bench can plan for it:data: gauge, Pareto α = 2.0, series scaled by Zipf θ = 1.1 over the 10,000 leaves, 10 samples/s per series, 4-levelchild_ofhierarchy (region → service → job → label_0)data_total: counter, same hierarchy/rate/keysevents: records table; labels region/service/job/label_0 uniform (skew 0);user_idZipf θ = 1.1 over 10,000 keys; 10 records/s per leaf series (100,000/s total)- the cardinality RQE's
metricbecomesevents(the table its SQL reads)
- Regenerate and re-commit the seed-862 manifests; keep the byte-identical-for-a-fixed-seed test.
- Update the design doc (
.design_docs/accelerated-random-workload-eval.md) where it describesdata_facts.
The leaf JSON must deserialize into A1's type; if A1 has not merged, mirror its field names exactly.
Done when
- generator emits
expr+ feeder-format facts; tests cover both; manifests regenerated - the paced feeder accepts the manifest's metrics block (validated by running its parser on one manifest, or a test)
Reactions are currently unavailable
Activity
milindsrivastava1997 commentedon Oct 14, 2026
Tracker: #886
milindsrivastava1997 commentedon Oct 15, 2026
Superseded: the feeder-format data facts landed in #879, and RQE trees for random workloads are written by sketch-bench#228 (merged with sketch-bench#226).