Measurement error can be very difficult to assess and reduce. While there have been great strides in the field of survey methods research in recent years, m any ongoing federal surveys were initiated decades ago, before testing methods were fully developed. However, the longer a survey is in use, the more established the time series becomes, and any change to a questionnaire risks a break in that time series. This paper documents how a major federal survey – the health insurance module of the Current Population Survey (CPS) – was redesigned over the course of 15 years (1999 - 2014) through a systematic series of small, iterative tests, both qualitative and quantitative , and implemented in production beginning in the spring of 2014 . This overview summarizes those tests and results, and illustrates how particular questionnaire design features were identified as problematic, and how improvements were developed and evaluated. The paper also addresses measurement challenges that emerged during the testing: passage of federal legislation on health reform (aka: the Affordable Care Act). While the particular topic is health insurance, the general approach (a coordinated series of small tests), along with the specific tests and methods employed, are not uniquely applicable to health insurance. Furthermore, the particular questionnaire design features of the CPS health module that were found to be most problematic are used in many other major surveys on a range of topic areas.
WORKING PAPER | JANUARY 14, 2015
Final Report: National Teacher and Principal Survey (NTPS)
The goal of the testing was to evaluate question wording, as well as compare answers to question pairs.
WORKING PAPER | AUGUST 26, 2015
Cognitive Testing of the ACS Language Questions in Spanish
The U.S. Census Bureau’s American Community Survey (ACS) is the primary source of data on languages spoken in the U.S. Respondents.
WORKING PAPER | SEPTEMBER 29, 2015
Usability Testing of the 2014 Census Test
In 2014, a usability evaluation was conducted of a proposed online instrument to be used by respondents selected for the 2014 Census Test who reported online.