Skip to content

How accurate AERIS forecasts are

For each oblast, AERIS estimates the probability that an official air-raid alert will start there within the next 30 minutes. Every forecast is checked automatically once that time has passed. This is the honest summary: we count only forecasts made while the oblast had no alert yet, because during an alert “there will be an alert” is almost certain and says nothing about quality.

7 days30 days90 days
When risk is high
61%
an alert really did start (usual rate: 18.3%)
Alerts foreseen
44%
rated at least elevated risk in advance
Better than the usual rate
+17%
Brier skill: 0% means no better than always giving the average rate
Forecasts checked
23,652
4,321 of them came before an alert

Can you trust the percentages

If a forecast says “30%”, an alert should start in about 30% of such cases. The grey bar is what we forecast; the coloured bar is how often an alert really started.

By oblast

Forecasts for the next 30 minutes, only those made with no active alert at the time.

Forecast accuracy by oblast, 90 days
OblastForecastsBefore an alertHigh risk → alertAlerts foreseenBetter than the rate
Cherkasy Oblast1,05226767%55%+10%
Chernihiv Oblast24112356%84%-8%
Chernivtsi Oblast1,530163—1%+3%
Dnipropetrovsk Oblast7550%40%-61%
Donetsk Oblast5632—81%-6%
Ivano-Frankivsk Oblast1,71993—0%+7%
Kharkiv Oblast2911—36%-6%
Kherson Oblast1,566156—8%-2%
Khmelnytskyi Oblast1,23823460%35%+12%
Kirovohrad Oblast93231559%62%+5%
Kyiv City1,370236—4%+2%
Kyiv Oblast49425171%84%+8%
Luhansk Oblast162—0%-8%
Lviv Oblast1,697100—2%+8%
Mykolaiv Oblast1,07332343%44%+10%
Odesa Oblast1,31528737%36%+8%
Poltava Oblast86429838%62%-3%
Rivne Oblast1,23024364%31%+13%
Sumy Oblast26116374%93%-1%
Ternopil Oblast1,558172—12%+9%
Vinnytsia Oblast1,06429054%67%+7%
Volyn Oblast1,492172—3%+12%
Zakarpattia Oblast1,8115—0%-50%
Zaporizhzhia Oblast16311269%86%-19%
Zhytomyr Oblast87426863%50%+7%

Other horizons

The forecast is a statistical estimate of risk for the oblast as a whole, not a warning. It does not say where or when anything will strike, and it does not replace official air-raid alert signals: in danger, act on them.

How we count: a forecast counts as correct if an official alert started in the oblast within its horizon (alerts.in.ua; for Kyiv, Kyiv Digital). “High risk” means the “high” and “critical” levels; “foreseen” means the level before the alert was at least “elevated”. Model versions in this period: forecast-logistic-1, forecast-logistic-2, forecast-logistic-3, forecast-logistic-4, forecast-logistic-5.