U.S. flag

An official website of the United States government

Skip Header


The SIPP Cognitive Research Evaluation Experiment: Basic Results and Documentation

Written by:
Working Paper Number SEHSD-WP1996-01 or SIPP-WP-212

This paper reports the general results of research undertaken by Census Bureau staff. It borrows substantially from a recent summary paper prepared by the second author for the Census Bureau's Annual Research Conference (Marquis, 1995), and from several other earlier reports. The views expressed are the authors' and should not be interpreted as official positions of the U.S. Census Bureau.

Abstract

In response to known and suspected problems in the measurement of program participation and related variables, Census Bureau research staff developed new, experimental survey procedures, based on cognitive theory and research, to reduce response errors in the Survey of Income and Program Participation (SIPP). We implemented a "field laboratory" test of the new procedures, using both an experimental design and an administrative record check. A key feature of the new procedures was getting households to use their personal income records as a substitute for faulty, minimum effort memory retrieval. Results of the SIPP Cognitive Research Evaluation Experiment indicate that the new procedures had no important effects on reducing either underreporting or overreporting errors in respondents' reports of participation in the income programs tested. However, by the second interview wave, the new procedures did produce substantial improvement in the reporting of income amounts. Experimental group households did use personal income records at astonishingly high rates; furthermore, record use correlated with the quality of income amount reporting.

This paper describes the basic features of the experimental procedures and their evolution; it presents the available evidence concerning the implementation of those procedures; it summarizes the key substantive findings of the experiment concerning program participation and program income reporting quality; and finally, it offers some possible reasons why record use did not affect reporting of program participation, but did have important effects on income amount reports.

Page Last Revised - October 8, 2021
Is this page helpful?
Thumbs Up Image Yes Thumbs Down Image No
NO THANKS
255 characters maximum 255 characters maximum reached
Thank you for your feedback.
Comments or suggestions?

Top

Back to Header