QPF Verification Information

This verification table shows statistics for 12-hr Quantitative Precipitation Forecasts (QPF) valid at 1200 and 0000 UTC from various numerical weather prediction models and manually derived value added forecasts from three different National Weather Service forecast centers; California Nevada River Forecast Center (CNRFC), the Weather Prediction Center of NCEP (WPC), and the Eureka and San Francisco Bay Area Forecast Offices. These models and forecasts are defined in the table below. The statistics provided are derived from a contingency table showing 12-hr forecast (QPF) and observed 12-hr precipitation (QPE) divided into 7 categories. If the forecast and observed 12-hr rainfall fall in the same category this is a hit. Otherwise this is a miss. The % correct, % to wet and % to dry are provided. The verification table shows the best guidance for the given duration of forecast selected, i.e. .5 days to 60 days, plus the next two best guidance and finally the worst guidance. Depending on the score chosen, color coding is used to show the quality of the particular model compared to the other forecasts. (green- top third, white- middle third, red- bottom third). If a duration longer than one-half day is chosen, a list of the wettest days over the watershed and the selected models performance is provided up to the ten wettest days. Missing forecasts are noted with dashes. Since the CNRFC tags all forecast with a 12z issuance time there will be no verification when the valid time is for 0000Z.


 

Threat Score (TS): A verification measure of categorical forecast performance equal to the total number of correct event forecasts (hits) divided by the total number of event forecasts plus the number of misses (hits + false alarms + misses). The TS is not affected by the number of no-event forecasts that are not observed (correct rejections). For this verification .5”/12hrs or greater precipitation is the threshold being verified.


Heidke Skill Score (HSS)1: A skill corrected verification measure of categorical forecast performance similar to the Percentage correct (PC) but which takes into account the number of hits due to chance. Hits due to chance are given as the event relative frequency multiplied by the number of event forecasts.


 

Table defining models or forecast verified in drop-down menu

Model Description Resolution Lead Time (HRS) Time-Step Frequency
NAM12 North American Model 12 km 84 3-hours, 00 & 12 UTC
NAMNest NAM Nest for Fire Weather CONUS 5 km 60 6-hours, 00 & 12 UTC
NAM40 North American Model 40 km 84 3-hours, 00 & 12 UTC
GFS20 Global Forecast System 28 km 240 6-hours, 00 & 12 UTC
GFS1hr Global Forecast System 28 km
CMCnh Canadian Model Northern Hemisphere 25 km 240 6-hours, 00 & 12 UTC
CMCreg Canadian Model Regional 10 km 48
SREF Short Range Ensemble Forecast 40 km 78 3-hours, 09 & 21 UTC
ECMWF European Center for Medium Range Forecasting (Provided to NOAA through special agreement with European Center 111 km 240 6-hours, 00 & 12 UTC
HIRESWarw Weather Research and Forecast model HIgh RESolution Western Non-Hydrostatic Mesoscale WRF Core 2.5 km 60 3-hours, 00 & 12 UTC
HIRESWnmm Weather Research and Forecast model HIgh RESolution Western Non-Hydrostatic Mesoscale Model Core 2.5 km 60 3-hours, 00 & 12 UTC
HRRR2 High Resolution Rapid Refresh 3 km 18 1 hour
CONSALL Equal blend of models at each gridpoint. GFS, CMCnh, CMCReg, NAM12,, SREF, ECMWF, RAP13, HRRR, HIRESWarw, HIRESWnmm, MOSGuide Mapped to 2.5 km 240 6-hours 00 & 12 UTC
CONSRaw Same as CONSALL except MOSGuide Mapped to 2.5 km 240 6-hours 00 & 12 UTC
CONSShort Official, RAP13, NAM12, NamDNG, HRRR, HIRESWarw, HIRESWnmm, GFS1hr Mapped to 2.5 km 36 1 hour
NBM National Blend Models https://www.weather.gov/mdl/nbm_home Mapped to 2.5 km 240 6-hours, 00 & 12 UTC
SuperBlend 80% of CONSALL and 20% of previous models listed under CONSALL that are missing Mapped to 2.5 km 240 6-hours, 00 & 12 UTC
NationalBlend Initial Version of NBM Mapped to 2.5 km 240 6-hours, 00 & 12 UTC
RFCQPF California-Nevada River Forecast Center QPF 12 km 120 6-hours, 12 UTC
WPCGuide Weather Prediction Center QPF Grid 12 km 120 12-hours, 00 UTC
MTRWRF Monterey NWS WFO WRF (Not available for Lake Mendocino Watershed or all of Russian River Watershed. See www.wrh.noaa.gov/mtr/mtrwrf.php) 3 km 84 1 hr, 00 & 12 UTC
RFCQPE CNRFC 6-hr QPE 12 km 24 12 UTC
Official San Francisco Bay Area Forecast Office QPF 2.5 km 84 12-hours, 00 UTC

1Jolliffe, I. T., and D. B. Stephenson, 2003: Forecast Verification: A Practitioner’s Guide in Atmospheric Science. John Wiley and Sons, 254 pp.

2HRRR will be available when the forecasts extend beyond 24-hrs. This should occur in May 2018.