4.6 Article

Astraea: Grammar-Based Fairness Testing

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article Computer Science, Software Engineering

Machine Learning Testing: Survey, Landscapes and Horizons

Jie M. Zhang et al.

Summary: This paper provides a comprehensive survey of techniques for testing machine learning systems and analyzes trends and challenges in ML testing, offering promising research directions for the future.

IEEE TRANSACTIONS ON SOFTWARE ENGINEERING (2022)

Article Computer Science, Software Engineering

BiasFinder: Metamorphic Test Generation to Uncover Bias for Sentiment Analysis Systems

Muhammad Hilmi Asyrofi et al.

Summary: This paper presents BiasFinder, an approach that can discover biased predictions in sentiment analysis systems via metamorphic testing. BiasFinder automatically curates suitable templates and generates new texts to uncover bias in systems.

IEEE TRANSACTIONS ON SOFTWARE ENGINEERING (2022)

Article Computer Science, Software Engineering

Grammar Based Directed Testing of Machine Learning Systems

Sakshi Udeshi et al.

Summary: The paper introduces a systematic test framework for machine-learning systems, called the Ogma approach, which can discover erroneous behaviors and improve model performance. Testing on three natural language processing classifiers shows that Ogma is more effective than random testing methods.

IEEE TRANSACTIONS ON SOFTWARE ENGINEERING (2021)

Proceedings Paper Computer Science, Software Engineering

BiasRV: Uncovering Biased Sentiment Predictions at Runtime

Zhou Yang et al.

Summary: This paper introduces BiasRV, a tool that can raise an alarm when a deployed SA system makes biased predictions on given input text at runtime. By dynamically extracting templates and generating gender-discriminatory mutants, BiasRV defines the distributional fairness property to evaluate the overall fairness of an SA system.

PROCEEDINGS OF THE 29TH ACM JOINT MEETING ON EUROPEAN SOFTWARE ENGINEERING CONFERENCE AND SYMPOSIUM ON THE FOUNDATIONS OF SOFTWARE ENGINEERING (ESEC/FSE '21) (2021)

Proceedings Paper Computer Science, Software Engineering

Fair Preprocessing: Towards Understanding Compositional Fairness of Data Transformers in Machine Learning Pipeline

Sumon Biswas et al.

Summary: This paper discusses the fairness impact of data preprocessing stages in machine learning pipelines, identifying certain data transformers causing model unfairness and proposing a fairness composition method for choosing appropriate downstream transformers to mitigate unfairness.

PROCEEDINGS OF THE 29TH ACM JOINT MEETING ON EUROPEAN SOFTWARE ENGINEERING CONFERENCE AND SYMPOSIUM ON THE FOUNDATIONS OF SOFTWARE ENGINEERING (ESEC/FSE '21) (2021)

Proceedings Paper Computer Science, Software Engineering

Bias in Machine Learning Software: Why? How? What to Do?

Joymallya Chakraborty et al.

Summary: This study addresses bias in software decisions and proposes a new solution. By eliminating biased labels and rebalancing internal distributions, it reduces bias while increasing performance and maintaining fairness.

PROCEEDINGS OF THE 29TH ACM JOINT MEETING ON EUROPEAN SOFTWARE ENGINEERING CONFERENCE AND SYMPOSIUM ON THE FOUNDATIONS OF SOFTWARE ENGINEERING (ESEC/FSE '21) (2021)

Proceedings Paper Computer Science, Software Engineering

Fairea: A Model Behaviour Mutation Approach to Benchmarking Bias Mitigation Methods

Max Hort et al.

Summary: The study introduces a new approach for evaluating the effectiveness of bias mitigation methods in machine learning, revealing that some of these methods have poor effectiveness.

PROCEEDINGS OF THE 29TH ACM JOINT MEETING ON EUROPEAN SOFTWARE ENGINEERING CONFERENCE AND SYMPOSIUM ON THE FOUNDATIONS OF SOFTWARE ENGINEERING (ESEC/FSE '21) (2021)

Review Computer Science, Artificial Intelligence

Contrastive explanation: a structural-model approach

Tim Miller

Summary: This paper introduces a model of contrastive explanation using structural casual models, aiming to help researchers in subfields of artificial intelligence better understand contrastive explanation by demonstrating it on two classical problems.

KNOWLEDGE ENGINEERING REVIEW (2021)

Proceedings Paper Automation & Control Systems

Cats Are Not Fish: Deep Learning Testing Calls for Out-Of-Distribution Awareness

David Berend et al.

2020 35TH IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING (ASE 2020) (2020)

Article Sociology

Autonomous automobilities: The social impacts of driverless vehicles

David Bissell et al.

CURRENT SOCIOLOGY (2020)

Proceedings Paper Automation & Control Systems

Systematically Covering Input Structure

Nikolas Havrikov et al.

34TH IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING (ASE 2019) (2019)

Proceedings Paper Computer Science, Software Engineering

Fairness Definitions Explained

Sahil Verma et al.

2018 IEEE/ACM INTERNATIONAL WORKSHOP ON SOFTWARE FAIRNESS (FAIRWARE 2018) (2018)

Article Multidisciplinary Sciences

Semantics derived automatically from language corpora contain human-like biases

Aylin Caliskan et al.

SCIENCE (2017)

Proceedings Paper Computer Science, Software Engineering

Fairness Testing: Testing Software for Discrimination

Sainyam Galhotra et al.

ESEC/FSE 2017: PROCEEDINGS OF THE 2017 11TH JOINT MEETING ON FOUNDATIONS OF SOFTWARE ENGINEERING (2017)

Article Computer Science, Software Engineering

FairSquare: Probabilistic Verification of Program Fairness

Aws Albarghouthi et al.

PROCEEDINGS OF THE ACM ON PROGRAMMING LANGUAGES-PACMPL (2017)

Article Computer Science, Software Engineering

The Oracle Problem in Software Testing: A Survey

Earl T. Barr et al.

IEEE TRANSACTIONS ON SOFTWARE ENGINEERING (2015)

Proceedings Paper Computer Science, Software Engineering

How Effective Are Code Coverage Criteria?

Hadi Hemmati

2015 IEEE INTERNATIONAL CONFERENCE ON SOFTWARE SECURITY AND RELIABILITY (QRS 2015) (2015)

Proceedings Paper Computer Science, Artificial Intelligence

Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Images

Anh Nguyen et al.

2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) (2015)

Proceedings Paper Computer Science, Software Engineering

A Practical Guide for Using Statistical Tests to Assess Randomized Algorithms in Software Engineering

Andrea Arcuri et al.

2011 33RD INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE) (2011)

Proceedings Paper Computer Science, Information Systems

Building Classifiers with Independency Constraints

Toon Calders et al.

2009 IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW 2009) (2009)

Article Business

Consumer Power: A Comparison of the Old Economy and the Internet Economy

Behrang Rezabakhsh et al.

JOURNAL OF CONSUMER POLICY (2006)

Article History & Philosophy Of Science

Causes and explanations: A structural-model approach. Part I: Causes

JY Halpern et al.

BRITISH JOURNAL FOR THE PHILOSOPHY OF SCIENCE (2005)

Article Computer Science, Artificial Intelligence

A machine learning approach to coreference resolution of noun phrases

WM Soon et al.

COMPUTATIONAL LINGUISTICS (2001)