Skip to content

Metrics Reference

Continuous Cell-Level Metrics

These metrics are computed at every grid cell for every timestep.

Key Name Formula Units
ne Normalised Error (test - source) / source * 100 percent
ane Absolute Normalised Error abs((test - source) / source) * 100 percent
rse Root Squared Error sqrt((test - source)^2) same as variable
bias Mean Error (Bias) test - source same as variable
mae Mean Absolute Error abs(test - source) same as variable

Categorical Cell-Level Metrics

Require a threshold parameter. Events are defined as values exceeding the threshold.

Key Name Formula Range
pod Probability of Detection Hits / (Hits + Misses) 0--1
far False Alarm Ratio False Alarms / (Hits + False Alarms) 0--1
csi Critical Success Index Hits / (Hits + False Alarms + Misses) 0--1
fbias Frequency Bias (Hits + False Alarms) / (Hits + Misses) 0--inf

Domain-Aggregated Metrics

Computed over the spatial domain for each timestep.

Key Name Description
ne Normalised Error NE computed from domain-summed values
ane Absolute Normalised Error ANE computed from domain-summed values
rmse Root Mean Square Error Spatially aggregated RMSE
bias Mean Error Spatially aggregated bias
pearson Pearson Correlation Spatial correlation coefficient (-1 to 1)
pod Probability of Detection From domain contingency table
far False Alarm Ratio From domain contingency table
csi Critical Success Index From domain contingency table
gss Gilbert Skill Score Equitable threat score from domain contingency table
fbias Frequency Bias From domain contingency table

Station Metrics

Per-station time series metrics.

Key Name Description
bias Mean Bias Mean difference (model - obs)
mae Mean Absolute Error Mean absolute difference
rmse Root Mean Square Error RMS of differences
ne Normalised Error Normalised by observed values
ane Absolute Normalised Error Absolute normalised difference
pearson Pearson Correlation Temporal correlation per station

Wind Metrics

Vector wind evaluation from U/V components.

Key Name Units Description
vector_rmse Vector RMSE m/s sqrt(mean(du^2 + dv^2))
speed_bias Wind Speed Bias m/s mean(test_speed - source_speed)
direction_bias Wind Direction Bias degrees Mean directional difference (-180 to 180)

Fractions Skill Score (FSS)

Spatial verification at multiple neighborhood scales (default: 1, 3, 5, 9, 17, 33, 65 grid cells).

Value Interpretation
0.0 No skill
0.5 Useful skill threshold
1.0 Perfect

Requires a threshold parameter to binarize the fields before computing fractions.

Diurnal Metrics

Any of the following metrics grouped by hour-of-day (0--23):

bias, rmse, mae, pearson

Supports a utc_offset parameter for local time conversion.