QPF Verification Information

This verification table shows statistics for either 12 or 24-hr Quantitative Precipitation Forecasts (QPF) valid at 1200 and/or 0000 UTC from various numerical weather prediction models and manually derived value added forecasts from three different National Weather Service forecast centers; California Nevada River Forecast Center (RFCQPF for 12z 24-hr only), the Weather Prediction Center of NCEP (WPC), and the Eureka and San Francisco Bay Area Forecast Offices (Official). These models and forecasts are defined in the table below. The statistics provided are derived from a contingency table showing 12 or 24-hr forecast (QPF) and observed 12 or 24-hr precipitation (QPE) divided into 7 categories. If the forecast and observed rainfall fall in the same category this is a hit. Otherwise this is a miss. The % correct, % to wet and % to dry are provided. The verification table shows the best guidance for the given duration of forecast selected, i.e. .5 (12-hr page) or 1 day (24-hr page) to 90 days, plus the next two best guidance forecasts and finally the worst guidance. Depending on the score chosen, color coding is used to show the quality of the particular model compared to the other forecasts. (green- top 25%, white- middle 50%, red- bottom 25% with brighter shading indicating the top or bottom 10%). If a duration longer than .5 (12-hr page) or 1 day (24-hr page) is chosen, a list of the wettest days over the watershed and the selected models performance is provided up to the ten wettest days. These statistics are for the first period only (12-hr lead time for 12-hr page or 0-hr lead time for 24-hr page). If a particular guidance forecast has no 12-hr or 0-hr forecast or is missing this will be noted with dashes. Three forecast products that fall into this category for the 0-hr lead time are Official, MOSGuide, and the NBM model. For these forecasts one should view the 12-hr verification page.


 

Threat Score (TS): A verification measure of categorical forecast performance equal to the total number of correct event forecasts (hits) divided by the total number of event forecasts plus the number of misses (hits + false alarms + misses). The TS is not affected by the number of no-event forecasts that are not observed (correct rejections). For this verification .5”/12hrs or greater precipitation is the threshold being verified.


Heidke Skill Score (HSS)1: A skill corrected verification measure of categorical forecast performance similar to the Percentage correct (PC) but which takes into account the number of hits due to chance. Hits due to chance are given as the event relative frequency multiplied by the number of event forecasts.


 

Table defining models or forecast verified in drop-down menu

Model Description Resolution Lead Time (HRS) Time-Step Frequency
NAM12 North American Model 12 km 84 3-hours, 00 & 12 UTC
NAMNest NAM Nest for Fire Weather CONUS 5 km 60 6-hours, 00 & 12 UTC
NAM40 North American Model 40 km 84 3-hours, 00 & 12 UTC
GFS20 Global Forecast System 28 km 240 6-hours, 00 & 12 UTC
GFS1hr Global Forecast System 28 km
CMCnh Canadian Model Northern Hemisphere 25 km 240 6-hours, 00 & 12 UTC
CMCreg Canadian Model Regional 10 km 48
SREF Short Range Ensemble Forecast 40 km 78 3-hours, 09 & 21 UTC
ECMWF European Center for Medium Range Forecasting (Provided to NOAA through special agreement with European Center 111 km 240 6-hours, 00 & 12 UTC
HIRESWarw Weather Research and Forecast model HIgh RESolution Western Non-Hydrostatic Mesoscale WRF Core 2.5 km 60 3-hours, 00 & 12 UTC
HIRESWnmm Weather Research and Forecast model HIgh RESolution Western Non-Hydrostatic Mesoscale Model Core 2.5 km 60 3-hours, 00 & 12 UTC
HRRR2 High Resolution Rapid Refresh 3 km 18 1 hour
CONSALL Equal blend of models at each gridpoint. GFS, CMCnh, CMCReg, NAM12,, SREF, ECMWF, RAP13, HRRR, HIRESWarw, HIRESWnmm, MOSGuide Mapped to 2.5 km 240 6-hours 00 & 12 UTC
CONSRaw Same as CONSALL except MOSGuide Mapped to 2.5 km 240 6-hours 00 & 12 UTC
CONSShort Official, RAP13, NAM12, NamDNG, HRRR, HIRESWarw, HIRESWnmm, GFS1hr Mapped to 2.5 km 36 1 hour
NBM National Blend Models https://www.weather.gov/mdl/nbm_home Mapped to 2.5 km 240 6-hours, 00 & 12 UTC
SuperBlend 80% of CONSALL and 20% of previous models listed under CONSALL that are missing Mapped to 2.5 km 240 6-hours, 00 & 12 UTC
NationalBlend Initial Version of NBM Mapped to 2.5 km 240 6-hours, 00 & 12 UTC
RFCQPF (12Z 24 hour only) California-Nevada River Forecast Center QPF 12 km 120 6-hours, 12 UTC
WPCGuide Weather Prediction Center QPF Grid 12 km 120 12-hours, 00 UTC
MTRWRF (AQPI only) Monterey NWS WFO WRF (Not available for Lake Mendocino Watershed or all of Russian River Watershed. See www.wrh.noaa.gov/mtr/mtrwrf.php) 3 km 84 1 hr, 00 & 12 UTC
RFCQPE CNRFC 6-hr QPE 12 km 24 12 UTC
Official San Francisco Bay Area Forecast Office QPF 2.5 km 84 12-hours, 00 UTC

1Jolliffe, I. T., and D. B. Stephenson, 2003: Forecast Verification: A Practitioner’s Guide in Atmospheric Science. John Wiley and Sons, 254 pp.

2The HRRR became available on August 31, 2018