Skip to content

How accurate AERIS forecasts are

For each oblast, AERIS estimates the probability that an official air-raid alert will start there within the next 30 minutes. Every forecast is checked automatically once that time has passed. This is the honest summary: we count only forecasts made while the oblast had no alert yet, because during an alert “there will be an alert” is almost certain and says nothing about quality.

7 days30 days90 days
When risk is high
61%
an alert really did start (usual rate: 18.3%)
Alerts foreseen
44%
rated at least elevated risk in advance
Better than the usual rate
+17%
Brier skill: 0% means no better than always giving the average rate
Forecasts checked
23,305
4,269 of them came before an alert

Can you trust the percentages

If a forecast says “30%”, an alert should start in about 30% of such cases. The grey bar is what we forecast; the coloured bar is how often an alert really started.

By oblast

Forecasts for the next 30 minutes, only those made with no active alert at the time.

Forecast accuracy by oblast, 30 days
OblastForecastsBefore an alertHigh risk → alertAlerts foreseenBetter than the rate
Cherkasy Oblast1,04226166%55%+9%
Chernihiv Oblast23712055%83%-8%
Chernivtsi Oblast1,505163—1%+3%
Dnipropetrovsk Oblast7550%40%-61%
Donetsk Oblast5632—81%-6%
Ivano-Frankivsk Oblast1,69493—0%+7%
Kharkiv Oblast2911—36%-6%
Kherson Oblast1,547154—8%-1%
Khmelnytskyi Oblast1,21323460%35%+12%
Kirovohrad Oblast92831259%62%+4%
Kyiv City1,351232—4%+2%
Kyiv Oblast48724771%85%+8%
Luhansk Oblast162—0%-8%
Lviv Oblast1,672100—2%+8%
Mykolaiv Oblast1,06131443%44%+10%
Odesa Oblast1,30328137%37%+8%
Poltava Oblast85529235%61%-3%
Rivne Oblast1,20524364%31%+13%
Sumy Oblast25616075%93%-1%
Ternopil Oblast1,533172—12%+9%
Vinnytsia Oblast1,04328853%67%+8%
Volyn Oblast1,467172—3%+12%
Zakarpattia Oblast1,7865—0%-49%
Zaporizhzhia Oblast16011075%85%-19%
Zhytomyr Oblast85226663%50%+8%

Other horizons

The forecast is a statistical estimate of risk for the oblast as a whole, not a warning. It does not say where or when anything will strike, and it does not replace official air-raid alert signals: in danger, act on them.

How we count: a forecast counts as correct if an official alert started in the oblast within its horizon (alerts.in.ua; for Kyiv, Kyiv Digital). “High risk” means the “high” and “critical” levels; “foreseen” means the level before the alert was at least “elevated”. Model versions in this period: forecast-logistic-1, forecast-logistic-2, forecast-logistic-3, forecast-logistic-4, forecast-logistic-5.