Skip to content

Free for nonprofits, NGOs, think tanks, and institutes. Grant funded by James Scott, administered by the Embassy Row Project.

ArtOfTheHack home

KRYOS-XS Hypercube method

Calibration and Outcome Feedback

Observed outcomes are fed back into the engine so confidence scores are measured against reality rather than asserted.

What it is

The method in plain terms

After execution, the actual result is recorded against the prediction. Over time this produces a measured calibration curve: when the engine says eighty percent confidence, how often is it correct.

Calibration drift is reported to the organization, and reasoning versions that degrade are identified rather than quietly retained.

Why it matters

A confidence score that has never been checked against outcomes is decoration. Calibration is what makes the number usable by a person deciding whether to act on it.

Applied

How it is used in a nonprofit environment

  • Showing a board whether the security posture is actually improving across reporting periods
  • Identifying decision classes where the organization should require more human review
  • Retiring suppression and automation rules that stopped being accurate

Limits

Where the method stops

  • Calibration requires outcome reporting; decisions with no recorded outcome cannot be scored
  • Early in a grant period, calibration data is sparse and confidence intervals are correspondingly wide

Calibration is computed per grantee against that grantee's own outcomes. Grantee data is not pooled without explicit consent.