Ops

ARX intelligence quality

Deterministic targets from ARX_QUALITY_STANDARDS.md. Each subsystem wires its live measurement as it lands. Skeleton today; tiles populate as ADR-0018 phases ship.

45 metrics tracked, 44 pending.

Reliability

Latency, uptime, error rates.

/api/arx/quote p95 latency

pending
Target
< 800 ms
Wired in
Phase C

/api/arx/quote p99 latency

pending
Target
< 2000 ms
Wired in
Phase C

Refresh cascade p99 wall-clock

pending
Target
< 30 s
Wired in
Phase C

Brain query p95 latency (ARX)

pending
Target
< 250 ms
Wired in
Phase B

Copilot first-token p95 (ARX)

pending
Target
< 2000 ms
Wired in
Phase D

Read endpoint uptime

pending
Target
>= 99.9%
Wired in
Phase C

Pipeline error rate

pending
Target
< 0.5%
Wired in
Phase B

Pricing source uptime

pending
Target
>= 99%
Wired in
Phase C

Data Quality

Corpus completeness, ingest lag, classification coverage.

Filing corpus completeness

pass
Target
>= 100%
Current
100%

Filing to Brain ingest lag (median)

pending
Target
< 60 s
Wired in
Phase B

Backfill total wall-clock

pending
Target
< 4 h
Wired in
Phase B

Embedding success rate

pending
Target
>= 99.5%
Wired in
Phase B

Sensitivity classification coverage

pending
Target
>= 100%
Wired in
Phase B

Duplicate (source_type, source_id) rows

pending
Target
<= 0
Wired in
Phase B

ARX-tagged email coverage

pending
Target
>= 99%
Wired in
Phase B

ARX-tagged audio coverage

pending
Target
>= 99%
Wired in
Phase B

Cross-source link density (ARX)

pending
Target
>= 2
Wired in
Phase B

Retrieval Quality

Gold-set Recall@5, NDCG@10, citation precision, hallucination rate.

Recall@5 over ARX corpus

pending
Target
>= 0.85
Wired in
Phase F

NDCG@10

pending
Target
>= 0.7
Wired in
Phase F

Cross-source rate

pending
Target
>= 60%
Wired in
Phase F

Citation precision

pending
Target
>= 98%
Wired in
Phase F

Hallucination rate

pending
Target
< 1%
Wired in
Phase F

Eval-set freshness

pending
Target
<= 90d
Wired in
Phase F

Analysis Quality

BLUF, anti-hedging, persona, tape-read structure compliance.

BLUF compliance

pending
Target
>= 100%
Wired in
Phase D

Anti-hedging compliance

pending
Target
>= 100%
Wired in
Phase D

PSU disclaimer must never preface analysis

pending
Target
>= 100%
Wired in
Phase A

Median analysis read time

pending
Target
< 90 s
Wired in
Phase D

Analyst-persona consistency

pending
Target
>= 100%
Wired in
Phase D

Tape-read structure compliance

pending
Target
>= 100%
Wired in
Phase D

Engineering Discipline

Type safety, coverage, ADR coverage, lead time, change failure rate.

`any` count in src/modules/arx/

pending
Target
<= 0
Wired in
Phase A

`!` non-null assertions in src/modules/arx/

pending
Target
<= 0
Wired in
Phase A

ARX module test coverage

pending
Target
>= 95%
Wired in
Phase A

ARX ADR coverage

pending
Target
>= 100%
Wired in
Phase A

Lead time for change (median)

pending
Target
< 24 h
Wired in
Phase F

Change failure rate (30d)

pending
Target
< 5%
Wired in
Phase F

Pre-commit PSU guard scope must not narrow

pending
Target
>= 1
Wired in
Phase A

Observability

Turn + run instrumentation completeness.

Copilot turn instrumentation completeness

pending
Target
>= 100%
Wired in
Phase D

Pipeline run instrumentation completeness

pending
Target
>= 100%
Wired in
Phase B

Daily quality scorecard render lag

pending
Target
< 60 s
Wired in
Phase F

Regression alert delivery lag

pending
Target
<= 15
Wired in
Phase F

Security and Privacy

Egress filter coverage, key rotation, secret scanning, audit log.

Position data egress filter coverage

pending
Target
>= 100%
Wired in
Phase A

API key rotation cadence

pending
Target
<= 90d
Wired in
Phase A

Secret-scanning gate findings

pending
Target
<= 0
Wired in
Phase A

Position-data audit log completeness

pending
Target
>= 100%
Wired in
Phase B

Dependency majors behind (ARX)

pending
Target
<= 3
Wired in
Phase A
Skeleton view. Live values populate as ADR-0018 phases B through F land. The thresholds rendered here are the source of truth read by the (eventual) CI ratchet.