Comparison of Parametric and Nonparametric Methods for Analyzing the Bias of a Numerical Model

Numerical models are presently applied in many fields for simulation and prediction, operation, or research. The output from these models normally has both systematic and random errors. The study compared January 2015 temperature data for Uganda as simulated using the Weather Research and Forecast m...

Full description

Saved in:
Bibliographic Details
Main Authors: Isaac Mugume, Charles Basalirwa, Daniel Waiswa, Joachim Reuder, Michel d. S. Mesquita, Sulin Tao, Triphonia J. Ngailo
Format: Article
Language:English
Published: Wiley 2016-01-01
Series:Modelling and Simulation in Engineering
Online Access:http://dx.doi.org/10.1155/2016/7530759
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832554065674895360
author Isaac Mugume
Charles Basalirwa
Daniel Waiswa
Joachim Reuder
Michel d. S. Mesquita
Sulin Tao
Triphonia J. Ngailo
author_facet Isaac Mugume
Charles Basalirwa
Daniel Waiswa
Joachim Reuder
Michel d. S. Mesquita
Sulin Tao
Triphonia J. Ngailo
author_sort Isaac Mugume
collection DOAJ
description Numerical models are presently applied in many fields for simulation and prediction, operation, or research. The output from these models normally has both systematic and random errors. The study compared January 2015 temperature data for Uganda as simulated using the Weather Research and Forecast model with actual observed station temperature data to analyze the bias using parametric (the root mean square error (RMSE), the mean absolute error (MAE), mean error (ME), skewness, and the bias easy estimate (BES)) and nonparametric (the sign test, STM) methods. The RMSE normally overestimates the error compared to MAE. The RMSE and MAE are not sensitive to direction of bias. The ME gives both direction and magnitude of bias but can be distorted by extreme values while the BES is insensitive to extreme values. The STM is robust for giving the direction of bias; it is not sensitive to extreme values but it does not give the magnitude of bias. The graphical tools (such as time series and cumulative curves) show the performance of the model with time. It is recommended to integrate parametric and nonparametric methods along with graphical methods for a comprehensive analysis of bias of a numerical model.
format Article
id doaj-art-1c3a529ecf46468aa962810976a0e739
institution Kabale University
issn 1687-5591
1687-5605
language English
publishDate 2016-01-01
publisher Wiley
record_format Article
series Modelling and Simulation in Engineering
spelling doaj-art-1c3a529ecf46468aa962810976a0e7392025-02-03T05:52:20ZengWileyModelling and Simulation in Engineering1687-55911687-56052016-01-01201610.1155/2016/75307597530759Comparison of Parametric and Nonparametric Methods for Analyzing the Bias of a Numerical ModelIsaac Mugume0Charles Basalirwa1Daniel Waiswa2Joachim Reuder3Michel d. S. Mesquita4Sulin Tao5Triphonia J. Ngailo6Department of Geography, Geoinformatics and Climatic Sciences, Makerere University, P.O. Box 7062, Kampala, UgandaDepartment of Geography, Geoinformatics and Climatic Sciences, Makerere University, P.O. Box 7062, Kampala, UgandaDepartment of Geography, Geoinformatics and Climatic Sciences, Makerere University, P.O. Box 7062, Kampala, UgandaGeophysical Institute, University of Bergen, Allegaten 70, 5007 Bergen, NorwayUni Research Climate, Bjerknes Centre for Climate Research, Bergen, NorwaySchool of Applied Meteorology, Nanjing University of Information Science and Technology, Nanjing, Jiangsu 21004, ChinaDepartment of General Studies, Dar es Salaam Institute of Technology, P.O. Box 2958, Dar-es-Salaam, TanzaniaNumerical models are presently applied in many fields for simulation and prediction, operation, or research. The output from these models normally has both systematic and random errors. The study compared January 2015 temperature data for Uganda as simulated using the Weather Research and Forecast model with actual observed station temperature data to analyze the bias using parametric (the root mean square error (RMSE), the mean absolute error (MAE), mean error (ME), skewness, and the bias easy estimate (BES)) and nonparametric (the sign test, STM) methods. The RMSE normally overestimates the error compared to MAE. The RMSE and MAE are not sensitive to direction of bias. The ME gives both direction and magnitude of bias but can be distorted by extreme values while the BES is insensitive to extreme values. The STM is robust for giving the direction of bias; it is not sensitive to extreme values but it does not give the magnitude of bias. The graphical tools (such as time series and cumulative curves) show the performance of the model with time. It is recommended to integrate parametric and nonparametric methods along with graphical methods for a comprehensive analysis of bias of a numerical model.http://dx.doi.org/10.1155/2016/7530759
spellingShingle Isaac Mugume
Charles Basalirwa
Daniel Waiswa
Joachim Reuder
Michel d. S. Mesquita
Sulin Tao
Triphonia J. Ngailo
Comparison of Parametric and Nonparametric Methods for Analyzing the Bias of a Numerical Model
Modelling and Simulation in Engineering
title Comparison of Parametric and Nonparametric Methods for Analyzing the Bias of a Numerical Model
title_full Comparison of Parametric and Nonparametric Methods for Analyzing the Bias of a Numerical Model
title_fullStr Comparison of Parametric and Nonparametric Methods for Analyzing the Bias of a Numerical Model
title_full_unstemmed Comparison of Parametric and Nonparametric Methods for Analyzing the Bias of a Numerical Model
title_short Comparison of Parametric and Nonparametric Methods for Analyzing the Bias of a Numerical Model
title_sort comparison of parametric and nonparametric methods for analyzing the bias of a numerical model
url http://dx.doi.org/10.1155/2016/7530759
work_keys_str_mv AT isaacmugume comparisonofparametricandnonparametricmethodsforanalyzingthebiasofanumericalmodel
AT charlesbasalirwa comparisonofparametricandnonparametricmethodsforanalyzingthebiasofanumericalmodel
AT danielwaiswa comparisonofparametricandnonparametricmethodsforanalyzingthebiasofanumericalmodel
AT joachimreuder comparisonofparametricandnonparametricmethodsforanalyzingthebiasofanumericalmodel
AT micheldsmesquita comparisonofparametricandnonparametricmethodsforanalyzingthebiasofanumericalmodel
AT sulintao comparisonofparametricandnonparametricmethodsforanalyzingthebiasofanumericalmodel
AT triphoniajngailo comparisonofparametricandnonparametricmethodsforanalyzingthebiasofanumericalmodel