arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Computer Science · Artificial Intelligence

Data Quality and Data Confidentiality for Microdata: Implica- tions and Strategies

Alan F. Karr, Ashish P. Sanil

See on the map

Abstract

National statistical agencies (and other organizations) must fulfill two nearly contradictory mis-sions. On the one hand, they must extract and disseminate—to other agencies, the research commu-nity and the public—useful information derived from sample surveys and censuses. But they must also protect the confidentiality of the data and the privacy of data subjects. Protecting confidentiality may be mandated by law, prescribed by agency practices or promised to respondents. Often, con-fidentiality must be preserved in order to ensure the quality of the data: respondents do not answer truthfully if they believe that their privacy is threatened. In this paper we describe two formulations that balance data quality and disclosure risk. These formulations can inform the strategies used by agencies to construct microdata releases. The first, for data swapping, uses explicit quantitative measures of data quality—the utility of the released microdata — and disclosure risk to produce a risk-utility frontier of undominated candidate releases, to which the agency can restrict its attention. Given a “utility function ” that trades off data quality for disclosure risk, an optimal release can be identified. The second, and rather different, setting is integration of distributed databases. There, arguably the quality is zero unless analyses that seem to but actually do not require integration of the data can be conducted safely.

More like this