Information from testing often provides additional empirical evidence to support prior judgments of a measure’s importance. In particular, beta testing results may reveal that a measure assesses an area with substantial opportunities for improvement. Testing can also uncover that the measure addresses a high-impact or meaningful aspect of health care.
Examples of Empirical Evidence
Examples of empirical evidence for importance or improvement opportunities derived from testing data include
- Quantifying the frequency or cost of measured events to demonstrate no measurement of rare or low-cost events
- Identifying substantial variation among comparison groups or suboptimal performance for a large portion of the groups
- Demonstrating that methods for scoring and analysis of the measure allow for identification of statistically significant and practically/clinically meaningful differences in performance
- Showing disparities in care related to race, ethnicity, gender, income, or other classifiers
- Identifying evidence that a measure is associated with consistent delivery of effective processes or access that leads to improved outcomes
Examples of Reported Data
Reported data to support the importance of a measure may include
- Descriptive statistics (e.g., means, medians, standard deviations, confidence intervals for proportions, percentiles) to demonstrate the existence of gaps or disparities.
- Analyses to quantify the amount of variation due to comparison groups such as rural versus urban through R2 or intraclass correlation.