4.7 Article

Reliability Assessment of Machine Learning Models in Hydrological Predictions Through Metamorphic Testing

Related references

Note: Only part of the references are listed.
Article Computer Science, Software Engineering

Scientific Software Testing Goes Serverless: Creating and Invoking Metamorphic Functions

Xuanyi Lin et al.

Summary: Our study demonstrates the process of FaaSifying scientific software testing and emphasizes the importance of value-driven evaluations through focusing on real-world defect detection.

IEEE SOFTWARE (2021)

Editorial Material Environmental Sciences

What Role Does Hydrological Science Play in the Age of Machine Learning?

Grey S. Nearing et al.

Summary: This paper is derived from a keynote talk given at Google's 2020 Flood Forecasting Meets Machine Learning Workshop. Recent experiments applying deep learning to rainfall-runoff simulation show that there is more information in large-scale hydrological data sets than previously thought. The paper calls for the hydrology community to focus on developing a quantitative understanding of the value of hydrological process understanding in a modeling discipline increasingly dominated by machine learning.

WATER RESOURCES RESEARCH (2021)

Proceedings Paper Computer Science, Software Engineering

Finding Metamorphic Relations for Scientific Software

Xuanyi Lin et al.

Summary: This study introduces an automatic approach to classify input and output variables from scientific software, mine variable associations, generate metamorphic relations, and validate them. Preliminary results on the Storm Water Management Model (SWMM) demonstrate the effectiveness of this method.

2021 IEEE/ACM 43RD INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING: COMPANION PROCEEDINGS (ICSE-COMPANION 2021) (2021)

Article Water Resources

Deep learning, hydrological processes and the uniqueness of place

Keith Beven

HYDROLOGICAL PROCESSES (2020)

Review Computer Science, Theory & Methods

Metamorphic Testing: A Review of Challenges and Opportunities

Tsong Yueh Chen et al.

ACM COMPUTING SURVEYS (2018)

Article Environmental Sciences

On hypothesis testing in hydrology: Why falsification of models is still a really good idea

Keith J. Beven

WILEY INTERDISCIPLINARY REVIEWS-WATER (2018)

Article Geosciences, Multidisciplinary

Rainfall-runoff modelling using Long Short-Term Memory (LSTM) networks

Frederik Kratzert et al.

HYDROLOGY AND EARTH SYSTEM SCIENCES (2018)

Review Environmental Sciences

A review on statistical postprocessing methods for hydrometeorological ensemble forecasting

Wentao Li et al.

WILEY INTERDISCIPLINARY REVIEWS-WATER (2017)

Article Geosciences, Multidisciplinary

Residual uncertainty estimation using instance-based learning with applications to hydrologic forecasting

Omar Wani et al.

HYDROLOGY AND EARTH SYSTEM SCIENCES (2017)

Review Computer Science, Interdisciplinary Applications

Sensitivity analysis of environmental models: A systematic review with practical workflow

Francesca Pianosi et al.

ENVIRONMENTAL MODELLING & SOFTWARE (2016)

Article Computer Science, Software Engineering

A Survey on Metamorphic Testing

Sergio Segura et al.

IEEE TRANSACTIONS ON SOFTWARE ENGINEERING (2016)

Article Geosciences, Multidisciplinary

HESS Opinions: Advocating process modeling and de-emphasizing parameter estimation

Abdolreza Bahremand

HYDROLOGY AND EARTH SYSTEM SCIENCES (2016)

Article Computer Science, Software Engineering

The Oracle Problem in Software Testing: A Survey

Earl T. Barr et al.

IEEE TRANSACTIONS ON SOFTWARE ENGINEERING (2015)

Review Computer Science, Artificial Intelligence

Support vector machine applications in the field of hydrology: A review

Sujay N. Raghavendra et al.

APPLIED SOFT COMPUTING (2014)

Article Computer Science, Software Engineering

How Effectively Does Metamorphic Testing Alleviate the Oracle Problem?

Huai Liu et al.

IEEE TRANSACTIONS ON SOFTWARE ENGINEERING (2014)

Review Engineering, Civil

Critical review of the evolution of the design storm event concept

Ed Watt et al.

CANADIAN JOURNAL OF CIVIL ENGINEERING (2013)

Article Computer Science, Interdisciplinary Applications

The Split-Apply-Combine Strategy for Data Analysis

Hadley Wickham

JOURNAL OF STATISTICAL SOFTWARE (2011)

Article Computer Science, Software Engineering

Testing and validating machine learning classifiers by metamorphic testing

Xiaoyuan Xie et al.

JOURNAL OF SYSTEMS AND SOFTWARE (2011)

Article Biochemical Research Methods

An innovative approach for testing bioinformatics programs using metamorphic testing

Tsong Yueh Chen et al.

BMC BIOINFORMATICS (2009)

Article Water Resources

Reconciling theory with observations: elements of a diagnostic approach to model evaluation

Hoshin V. Gupta et al.

HYDROLOGICAL PROCESSES (2008)

Article Computer Science, Interdisciplinary Applications

Data-driven modelling: some past experiences and new approaches

Dimitri P. Solomatine et al.

JOURNAL OF HYDROINFORMATICS (2008)

Article Geosciences, Multidisciplinary

Uncertainty, sensitivity analysis and the role of data based mechanistic modeling in hydrology

M. Ratto et al.

HYDROLOGY AND EARTH SYSTEM SCIENCES (2007)

Article Computer Science, Information Systems

Fault-based testing without the need of oracles

TY Chen et al.

INFORMATION AND SOFTWARE TECHNOLOGY (2003)