SIGNALAF

Test-Retest Reliability

0Concept

Whether the same operator measured twice under the same conditions produces the same metrics.

Definition

Whether the same operator measured twice under the same conditions produces the same metrics.

Inputs

Two or more measurements of the same operator under equivalent conditions.

Derived variables

Metric correlation between test and retest. Bland-Altman limits of agreement.

Claim

If the measurement is reliable, test-retest metrics should be highly correlated with small differences.

Test

Measure an operator, wait, measure again under equivalent conditions. Compute correlation and limits of agreement.

Observable

Correlation coefficient, Bland-Altman plot, intra-class correlation.

Falsifier

Low correlation or large systematic differences between test and retest.

Evidence

No formal test-retest studies yet. Proposed validation method.

Limitations

Conditions are never truly identical — tool versions, task types, and time effects introduce variance.

Lineage

Psychometric validation methodology, proposed for SigRank. Architecture: mos2es.com/architecture.