Analysis of Total Survey Error in the 2022 National Immunization Survey-Child

Oregon Convention Center 

Total survey error (TSE) is the difference between a survey estimate and the true value of the corresponding population parameter. We use TSE to evaluate sampling and nonsampling errors in vaccination coverage estimates for children aged 19-35 months from CDC's National Immunization Survey-Child. We derive estimates of sampling-frame coverage error, nonresponse error, measurement error, and sampling error using such data sources as the National Health Interview Survey and immunization information systems. A Monte Carlo approach then combines estimated distributions of error components into a TSE distribution for the survey estimate of vaccination coverage. The mean of the TSE distribution provides an estimate of total bias in the survey estimator, and the 95% credible interval provides an interval within which total survey error falls with 0.95 probability. Our estimates of mean TSE for 4+ doses of DTaP (-4.0 percentage points), 1+ doses of MMR (-1.7 pp), Hep B birth dose (-3.3 pp), and the combined 7-vaccine series (-9.2 pp) indicate underestimates of vaccination coverage. Measurement error (or provider underascertainment) is consistently found to be the largest error component.

Total survey error

Sampling-frame coverage error

Nonresponse error

Nonresponse error

Random digit dialing 

Survey Research Methods Section