4.3 Article

Regulating Government AI and the Challenge of Sociotechnical Design

Related references

Note: Only part of the references are listed.
Article Law

The flaws of policies requiring human oversight of government algorithms

Ben Green

Summary: As algorithms gain importance in government decision-making, policies requiring human oversight of algorithms suffer from flaws. First, evidence suggests that people are unable to effectively oversee algorithmic decision-making. Second, these policies legitimize the use of faulty algorithms without addressing their fundamental issues. Therefore, a shift to institutional oversight is proposed as a more effective mechanism for regulating government algorithms.

COMPUTER LAW & SECURITY REVIEW (2022)

Review Economics

We and It: An interdisciplinary review of the experimental evidence on how humans interact with machines

Marina Chugunova et al.

Summary: Humans' interactions with automation have been the focus of research across several fields, but with inconsistent findings. Reviewed studies show that people react differently to automated agents compared to humans, displaying more rational behavior and less emotional and social response. The design of the agents may mediate these differences. Factors such as task context, performance expectations, and decision authority distribution also impact human willingness to accept automated agents in decision-making.

JOURNAL OF BEHAVIORAL AND EXPERIMENTAL ECONOMICS (2022)

Proceedings Paper Computer Science, Interdisciplinary Applications

Beyond Ads: Sequential Decision-Making Algorithms in Law and Public Policy

Peter Henderson et al.

Summary: The article discusses the promises and challenges of using sequential decision-making algorithms in law and public policy, emphasizing the distinct methodological challenges posed in these fields compared to the private sector. Further research and development are needed to address these unique challenges in machine learning for law and public policy applications.

PROCEEDINGS OF THE 2022 SYMPOSIUM ON COMPUTER SCIENCE AND LAW, CSLAW 2022 (2022)

Article Law

Algorithms and Decision-Making in the Public Sector

Karen Levy et al.

Summary: This article examines the use of algorithmic systems in supporting decision-making in the public sector, and the important implications for accountability, privacy, social inequity, and public participation in decision-making. The authors highlight several open questions that require further empirical research.

ANNUAL REVIEW OF LAW AND SOCIAL SCIENCE, VOL 17 (2021)

Editorial Material Medicine, General & Internal

How US law will evaluate artificial intelligence for covid-19

Mark Krass et al.

BMJ-BRITISH MEDICAL JOURNAL (2021)

Article Law

MACHINE ADVICE WITH A WARNING ABOUT MACHINE LIMITATIONS: EXPERIMENTALLY TESTING THE SOLUTION MANDATED BY THE WISCONSIN SUPREME COURT

Christoph Engel et al.

Summary: The study shows that warnings about machine advice can affect participants' estimates and confidence, but do not change their decision to grant bail. Participants do not improve in identifying defendants who will recidivate in the next two years.

JOURNAL OF LEGAL ANALYSIS (2021)

Proceedings Paper Computer Science, Artificial Intelligence

Blind Justice: Algorithmically Masking Race in Charging Decisions

Alex Chohlas-Wood et al.

Summary: In order to reduce potential bias in charging decisions, a system was designed to algorithmically redact race-related information from case narratives. This tool was successfully deployed in a large district attorney's office, demonstrating its ability to obscure race-related information effectively.

AIES '21: PROCEEDINGS OF THE 2021 AAAI/ACM CONFERENCE ON AI, ETHICS, AND SOCIETY (2021)

Proceedings Paper Computer Science, Artificial Intelligence

Towards Unbiased and Accurate Deferral to Multiple Experts

Vijay Keswani et al.

Summary: This study aims to ensure accuracy and fairness in prediction systems that combine machine learning model inferences with domain expert predictions. By extending the deferral system framework to environments with multiple experts and testing it on synthetic and real-world datasets, the study shows significant improvements in prediction accuracy and fairness compared to baselines.

AIES '21: PROCEEDINGS OF THE 2021 AAAI/ACM CONFERENCE ON AI, ETHICS, AND SOCIETY (2021)

Proceedings Paper Computer Science, Interdisciplinary Applications

Manipulating and Measuring Model Interpretability

Forough Poursabzi-Sangdeh et al.

Summary: A series of experiments showed that clear, simple machine learning models did not result in participants following their predictions more closely, but instead made it harder for them to detect and correct the models' significant mistakes due to information overload.

CHI '21: PROCEEDINGS OF THE 2021 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (2021)

Article Sociology

Technologies of Crime Prediction: The Reception of Algorithms in Policing and Criminal Courts

Sarah Brayne et al.

Summary: This study evaluates the impact of predictive technologies in the criminal justice process, finding similar arguments used to justify the adoption of predictive algorithms in law enforcement and criminal courts, and documenting resistance among law enforcement and legal professionals towards predictive algorithms.

SOCIAL PROBLEMS (2021)

Article Health Care Sciences & Services

Do as AI say: susceptibility in deployment of clinical decision-aids

Susanne Gaube et al.

Summary: This study found that radiologists rated diagnostic advice as lower quality when it appeared to come from an AI system, while less experienced physicians did not have this bias. Diagnostic accuracy significantly decreased when participants received inaccurate advice, regardless of the purported source being AI or human experts. Therefore, important considerations need to be made when deploying advice in clinical environments, whether it is coming from AI or non-AI sources.

NPJ DIGITAL MEDICINE (2021)

Proceedings Paper Computer Science, Cybernetics

Bureaucracy as a Lens for Analyzing and Designing Algorithmic Systems

Juho Paakkonen et al.

PROCEEDINGS OF THE 2020 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'20) (2020)

Proceedings Paper Computer Science, Cybernetics

A Case for Humans-in-the-Loop: Decisions in the Presence of Erroneous Algorithmic Scores

Maria De-Arteaga et al.

PROCEEDINGS OF THE 2020 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'20) (2020)

Proceedings Paper Computer Science, Cybernetics

Re-examining Whether, Why, and How Human-Al Interaction Is Uniquely Difficult to Design

Qian Yang et al.

PROCEEDINGS OF THE 2020 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'20) (2020)

Proceedings Paper Computer Science, Artificial Intelligence

Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing

Inioluwa Deborah Raji et al.

FAT* '20: PROCEEDINGS OF THE 2020 CONFERENCE ON FAIRNESS, ACCOUNTABILITY, AND TRANSPARENCY (2020)

Article Political Science

A Practical Framework for Considering the Use of Predictive Risk Modeling in Child Welfare

Brett Drake et al.

ANNALS OF THE AMERICAN ACADEMY OF POLITICAL AND SOCIAL SCIENCE (2020)

Article Information Science & Library Science

Artificial intelligence, bureaucratic form, and discretion in public service

Justin Bullock et al.

INFORMATION POLITY (2020)

Article Business

ALGORITHMS AT WORK: THE NEW CONTESTED TERRAIN OF CONTROL

Katherine C. Kellogg et al.

ACADEMY OF MANAGEMENT ANNALS (2020)

Article Multidisciplinary Sciences

Dissecting racial bias in an algorithm used to manage the health of populations

Ziad Obermeyer et al.

SCIENCE (2019)

Proceedings Paper Computer Science, Theory & Methods

Fairness and Abstraction in Sociotechnical Systems

Andrew D. Selbst et al.

FAT*'19: PROCEEDINGS OF THE 2019 CONFERENCE ON FAIRNESS, ACCOUNTABILITY, AND TRANSPARENCY (2019)

Article Psychology, Applied

Making sense of recommendations

Michael Yeomans et al.

JOURNAL OF BEHAVIORAL DECISION MAKING (2019)

Article Public Administration

Artificial Intelligence, Discretion, and Bureaucracy

Justin B. Bullock

AMERICAN REVIEW OF PUBLIC ADMINISTRATION (2019)

Article Business

Resistance to Medical Artificial Intelligence

Chiara Longoni et al.

JOURNAL OF CONSUMER RESEARCH (2019)

Proceedings Paper Computer Science, Cybernetics

Street-Level Algorithms: A Theory at the Gaps Between Policy and Decisions

Ali Alkhatib et al.

CHI 2019: PROCEEDINGS OF THE 2019 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (2019)

Article Multidisciplinary Sciences

Algorithmic regulation and the rule of law

Mireille Hildebrandt

PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES (2018)

Article Law

Algorithmic regulation: A critical interrogation

Karen Yeung

REGULATION & GOVERNANCE (2018)

Article Law

DISCRIMINATION IN THE AGE OF ALGORITHMS

Jon Kleinberg et al.

JOURNAL OF LEGAL ANALYSIS (2018)

Article Economics

DISCRETION IN HIRING

Mitchell Hoffman et al.

QUARTERLY JOURNAL OF ECONOMICS (2018)

Article Computer Science, Interdisciplinary Applications

Fair Prediction with Disparate Impact: A Study of Bias in Recidivism Prediction Instruments

Alexandra Chouldechova

BIG DATA (2017)

Review Psychology, Clinical

Risk Assessment in Criminal Sentencing

John Monahan et al.

ANNUAL REVIEW OF CLINICAL PSYCHOLOGY, VOL 12 (2016)

Editorial Material Multidisciplinary Sciences

There is a blind spot in AI research

Kate Crawford et al.

NATURE (2016)

Article Political Science

A Systems Theory Approach to Innovation Implementation: Why Organizational Location Matters

Tima T. Moldogaziev et al.

JOURNAL OF PUBLIC ADMINISTRATION RESEARCH AND THEORY (2016)

Article Psychology, Experimental

Algorithm Aversion: People Erroneously Avoid Algorithms After Seeing Them Err

Berkeley J. Dietvorst et al.

JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL (2015)

Proceedings Paper Computer Science, Artificial Intelligence

Certifying and Removing Disparate Impact

Michael Feldman et al.

KDD'15: PROCEEDINGS OF THE 21ST ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING (2015)

Article Computer Science, Theory & Methods

A Survey on Concept Drift Adaptation

Joao Gama et al.

ACM COMPUTING SURVEYS (2014)

Article Sociology

When Organizations Rule: Judicial Deference to Institutionalized Employment Structures

Lauren B. Edelman et al.

AMERICAN JOURNAL OF SOCIOLOGY (2011)

Article Behavioral Sciences

Complacency and Bias in Human Use of Automation: An Attentional Integration

Raja Parasuraman et al.

HUMAN FACTORS (2010)

Article Information Science & Library Science

Data mining and the search for security: Challenges for connecting the dots and databases

JW Seifert

GOVERNMENT INFORMATION QUARTERLY (2004)

Article Computer Science, Cybernetics

Accountability and automation bias

LJ Skitka et al.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES (2000)