Test-Retest Reliability

Whether the same operator measured twice under the same conditions produces the same metrics.

Two or more measurements of the same operator under equivalent conditions.

Metric correlation between test and retest. Bland-Altman limits of agreement.

If the measurement is reliable, test-retest metrics should be highly correlated with small differences.

Measure an operator, wait, measure again under equivalent conditions. Compute correlation and limits of agreement.

Correlation coefficient, Bland-Altman plot, intra-class correlation.

Low correlation or large systematic differences between test and retest.

No formal test-retest studies yet. Proposed validation method.

Conditions are never truly identical — tool versions, task types, and time effects introduce variance.

Psychometric validation methodology, proposed for SigRank. Architecture: mos2es.com/architecture.