SWAT Literature Database for Peer-Reviewed Journal Articles

Title:Model evaluation guidelines for systematic quantification of accuracy in watershed simulations 
Authors:Moriasi, D.N., J.G. Arnold, M.W. Van Liew, R.L. Bingner, R.D. Harmel and T. Veith 
Journal:Transactions of the ASABE 
Volume (Issue):50(3) 
Article ID: 
URL (non-DOI journals): 
Broad Application Category:hydrologic and pollutant 
Primary Application Category:calibration, sensitivity, and/or uncertainty analysis 
Secondary Application Category:hydrologic assessment 
Watershed Description:9,312 km^2 Leon River, which drains portions of five counties to Lake Belton in central Texas, U.S. 
Calibration Summary:monthly stream flow NSE: =0.66 to 1.0 
Validation Summary:monthly stream flow NSE: =0.69 to 1.0 
General Comments:7 calibration gauges, 5 validation gauges 
Abstract:Watershed models are powerful tools for simulating the effect of watershed processes and management on soil and water resources. However, no comprehensive guidance is available to facilitate model evaluation in terms of the accuracy of simulated data compared to measured flow and constituent values. Thus, the objectives of this research were to: (1) determine recommended model evaluation techniques (statistical and graphical), (2) review reported ranges of values and corresponding performance ratings for the recommended statistics, and (3) establish guidelines for model evaluation based on the review results and project-specific considerations; all of these objectives focus on simulation of streamflow and transport of sediment and nutrients. These objectives were achieved with a thorough review of relevant literature on model application and recommended model evaluation methods. Based on this analysis, we recommend that three quantitative statistics, Nash-Sutcliffe efficiency (NSE), percent bias (PBIAS), and ratio of the root mean square error to the standard deviation of measured data (RSR), in addition to the graphical techniques, be used in model evaluation. The following model evaluation performance ratings were established for each recommended statistic. In general, model simulation can be judged as satisfactory if NSE > 0.50 and RSR < 0.70, and if PBIAS + 25% for streamflow, PBIAS + 55% for sediment, and PBIAS + 70% for N and P. For PBIAS, constituent-specific performance ratings were determined based on uncertainty of measured data. Additional considerations related to model evaluation guidelines are also discussed. These considerations include: single-event simulation, quality and quantity of measured data, model calibration procedure, evaluation time step, and project scope and magnitude. A case study illustrating the application of the model evaluation guidelines is also provided. 
Keywords:Accuracy, Model calibration and validation, Simulation, Watershed model