A Bayesian Method to Improve the Extrapolation Ability of ANNs

G.B. Kingston, H.R. Maier, and M.F. Lambert (Australia)


Artificial neural networks, hydrological forecasting, Bayesian estimation, Markov chain Monte Carlo


Although artificial neural networks have been shown to be superior prediction models in many hydrology-related ar eas, their known lack of extrapolation capability has lim ited the wider use and acceptance of ANNs as forecasting models. This problem lies mainly with the fact that a sin gle “most likely” weight vector, which is determined by calibration with a finite set of data, is used to define the function modelled by the ANN. There are, in fact, many different weight vectors that result in approximately equal model performance; however, standard ANN development approaches do not allow for any weight vectors, other than that which provides the best fit to the calibration data, to impact on the predictions made. In this paper, a Bayesian method is presented that enables the entire range of plausi ble weight vectors to be accounted for in the model predic tions. In doing so, the relationship modelled by the ANN is more general and less dominated by the information con tained in the calibration data. The method is applied to a real-world case study known to require extrapolation and the resulting ANN is shown to perform significantly better than an ANN developed using standard approaches.

Important Links:

Go Back