Unified Uncertainties: Combining Input, Data and Model Uncertainty into a Single Formulation

[Submitted on 26 Jun 2024]

View a PDF of the paper titled Unified Uncertainties: Combining Input, Data and Model Uncertainty into a Single Formulation, by Matias Valdenegro-Toro and Ivo Pascal de Jong and Marco Zullich

View PDF
HTML (experimental)

Abstract:Modelling uncertainty in Machine Learning models is essential for achieving safe and reliable predictions. Most research on uncertainty focuses on output uncertainty (predictions), but minimal attention is paid to uncertainty at inputs. We propose a method for propagating uncertainty in the inputs through a Neural Network that is simultaneously able to estimate input, data, and model uncertainty. Our results show that this propagation of input uncertainty results in a more stable decision boundary even under large amounts of input noise than comparatively simple Monte Carlo sampling. Additionally, we discuss and demonstrate that input uncertainty, when propagated through the model, results in model uncertainty at the outputs. The explicit incorporation of input uncertainty may be beneficial in situations where the amount of input uncertainty is known, though good datasets for this are still needed.