QPF Verification Information
This verification table shows statistics for 12-hr Quantitative Precipitation Forecasts (QPF) valid at 1200 and 0000 UTC from various numerical weather prediction models and manually derived value added forecasts from three different National Weather Service forecast centers; California Nevada River Forecast Center (CNRFC), the Weather Prediction Center of NCEP (WPC), and the Eureka and San Francisco Bay Area Forecast Offices. These models and forecasts are defined in the table below. The statistics provided are derived from a contingency table showing 12-hr forecast (QPF) and observed 12-hr precipitation (QPE) divided into 7 categories. If the forecast and observed 12-hr rainfall fall in the same category this is a hit. Otherwise this is a miss. The % correct, % to wet and % to dry are provided. The verification table shows the best guidance for the given duration of forecast selected, i.e. .5 days to 60 days, plus the next two best guidance and finally the worst guidance. Depending on the score chosen, color coding is used to show the quality of the particular model compared to the other forecasts. (green- top third, white- middle third, red- bottom third). If a duration longer than one-half day is chosen, a list of the wettest days over the watershed and the selected models performance is provided up to the ten wettest days. Missing forecasts are noted with dashes. Since the CNRFC tags all forecast with a 12z issuance time there will be no verification when the valid time is for 0000Z.
Threat Score (TS): A verification measure of categorical forecast performance equal to the total number of correct event forecasts (hits) divided by the total number of event forecasts plus the number of misses (hits + false alarms + misses). The TS is not affected by the number of no-event forecasts that are not observed (correct rejections). For this verification .5”/12hrs or greater precipitation is the threshold being verified.
Heidke Skill Score (HSS)1: A skill corrected verification measure of categorical forecast performance similar to the Percentage correct (PC) but which takes into account the number of hits due to chance. Hits due to chance are given as the event relative frequency multiplied by the number of event forecasts.
Table defining models or forecast verified in drop-down menu
Model | Description | Resolution | Lead Time (HRS) | Time-Step Frequency |
---|---|---|---|---|
NAM12 | North American Model | 12 km | 84 | 3-hours, 00 & 12 UTC |
NAMNest | NAM Nest for Fire Weather CONUS | 5 km | 60 | 6-hours, 00 & 12 UTC |
NAM40 | North American Model | 40 km | 84 | 3-hours, 00 & 12 UTC |
GFS20 | Global Forecast System | 28 km | 240 | 6-hours, 00 & 12 UTC |
GFS1hr | Global Forecast System | 28 km | ||
CMCnh | Canadian Model Northern Hemisphere | 25 km | 240 | 6-hours, 00 & 12 UTC |
CMCreg | Canadian Model Regional | 10 km | 48 | |
SREF | Short Range Ensemble Forecast | 40 km | 78 | 3-hours, 09 & 21 UTC |
ECMWF | European Center for Medium Range Forecasting (Provided to NOAA through special agreement with European Center | 111 km | 240 | 6-hours, 00 & 12 UTC |
HIRESWarw | Weather Research and Forecast model HIgh RESolution Western Non-Hydrostatic Mesoscale WRF Core | 2.5 km | 60 | 3-hours, 00 & 12 UTC |
HIRESWnmm | Weather Research and Forecast model HIgh RESolution Western Non-Hydrostatic Mesoscale Model Core | 2.5 km | 60 | 3-hours, 00 & 12 UTC |
HRRR2 | High Resolution Rapid Refresh | 3 km | 18 | 1 hour |
CONSALL | Equal blend of models at each gridpoint. GFS, CMCnh, CMCReg, NAM12,, SREF, ECMWF, RAP13, HRRR, HIRESWarw, HIRESWnmm, MOSGuide | Mapped to 2.5 km | 240 | 6-hours 00 & 12 UTC |
CONSRaw | Same as CONSALL except MOSGuide | Mapped to 2.5 km | 240 | 6-hours 00 & 12 UTC |
CONSShort | Official, RAP13, NAM12, NamDNG, HRRR, HIRESWarw, HIRESWnmm, GFS1hr | Mapped to 2.5 km | 36 | 1 hour |
NBM | National Blend Models https://www.weather.gov/mdl/nbm_home | Mapped to 2.5 km | 240 | 6-hours, 00 & 12 UTC |
SuperBlend | 80% of CONSALL and 20% of previous models listed under CONSALL that are missing | Mapped to 2.5 km | 240 | 6-hours, 00 & 12 UTC |
NationalBlend | Initial Version of NBM | Mapped to 2.5 km | 240 | 6-hours, 00 & 12 UTC |
RFCQPF | California-Nevada River Forecast Center QPF | 12 km | 120 | 6-hours, 12 UTC |
WPCGuide | Weather Prediction Center QPF Grid | 12 km | 120 | 12-hours, 00 UTC |
MTRWRF | Monterey NWS WFO WRF (Not available for Lake Mendocino Watershed or all of Russian River Watershed. See www.wrh.noaa.gov/mtr/mtrwrf.php) | 3 km | 84 | 1 hr, 00 & 12 UTC |
RFCQPE | CNRFC 6-hr QPE | 12 km | 24 | 12 UTC |
Official | San Francisco Bay Area Forecast Office QPF | 2.5 km | 84 | 12-hours, 00 UTC |
1Jolliffe, I. T., and D. B. Stephenson, 2003: Forecast Verification: A Practitioner’s Guide in Atmospheric Science. John Wiley and Sons, 254 pp.
2HRRR will be available when the forecasts extend beyond 24-hrs. This should occur in May 2018.