Risk Lab · VaR backtest · CQF Module 2.3

🇪🇹ETB/USDETB

Managed float with a parallel-market premium — the only non-commodity in the lab.

Last price

0.0063

2026-06-01

Daily change

-0.32%

Day range

0.0062 – 0.0063

session

Method

Gaussian

recommended

Asset thesis · why this asset is different

0.The official rate is half the story

The Birr's official quote is a managed float and the realised return distribution understates true currency risk because parallel-market activity is invisible to the FMP feed. The lab here treats the official series as a lower bound on the actual return distribution and labels it accordingly. Gaussian VaR is sufficient for the visible series; the page's narrative does the heavy lifting on what the visible series leaves out.

  • Ethiopia's July 2024 currency liberalisation moved the official Birr ~30% in a single week — the page treats this as a regime change, not a tail event.
  • Parallel-market premium (street rate vs official) has historically run 50–80% in the years before liberalisation.
  • Coffee export receipts and remittance flows are the two dominant USD supply channels, both seasonal.

Recommended VaR method

Gaussian · Visible returns are dominated by managed regime; tails aren't real until you add the parallel-market signal, which this lab doesn't track. The honest method is the simple one.

Part I · the daily log-return series

1.From prices to returns

Everything that follows works on the daily log return rt=log(Pt/Pt1)r_t = \log(P_t / P_{t-1}). Log returns are time-additive, well-behaved under aggregation, and the natural input for any vol / VaR model. The series below is exactly that, computed over 621 trading days from Supabase data.

r_t over time · green up, red down

29.6%-29.6%2024-04-172026-06-01

μ (daily)

-0.165%

σ (daily)

1.59%

σ (annualised)

10.3%

n

621

observations

The annualised vol used in the EWMA model is the current value from the filter, not a pooled sample estimate. Pooled σ across the entire history would mask the regime structure CQF Module 2.5 cares about.

Part II · stylized facts (CQF Module 2.4)

2.The four moments

Returns are described by their first four sample moments. The first two get most of the airtime; the third and fourth are what break Gaussian VaR.

μ=1ntrt,σ2=1n1t(rtμ)2\mu = \frac{1}{n} \sum_t r_t, \quad \sigma^2 = \frac{1}{n-1} \sum_t (r_t - \mu)^2
γ1=1nt(rtμσ)3(skewness)\gamma_1 = \frac{1}{n}\sum_t \left(\frac{r_t - \mu}{\sigma}\right)^3 \quad (\text{skewness})
γ2=1nt(rtμσ)43(excess kurtosis)\gamma_2 = \frac{1}{n}\sum_t \left(\frac{r_t - \mu}{\sigma}\right)^4 - 3 \quad (\text{excess kurtosis})

The Gaussian benchmark has γ1=0\gamma_1 = 0 and γ2=0\gamma_2 = 0. The empirical values on this asset, computed on the live series above, are γ1=10.011\gamma_1 = -10.011 and γ2=143.94\gamma_2 = 143.94. Both numbers feed directly into the Cornish-Fisher VaR adjustment in Part III.

3.The empirical density vs normal

Plotting the histogram of rtr_t against a normal fitted to the same (μ,σ)(\mu, \sigma)makes the failure of the Gaussian assumption visible. Bars in the < μ − 2σ tail are coloured red; bars in the > μ + 2σ tail are green. A normal would have a fixed 2.5% mass in each tail; if the empirical bars overshoot the curve in those regions, you have fat tails.

-26.9%3.8%— normal( μ, σ )

4.The Q-Q diagnostic

The Q-Q plot pairs the ii-th empirical order statistic with the corresponding quantile of N(μ,σ2)\mathcal{N}(\mu, \sigma^2). Under normality every point sits on the 45-degree gold reference line. Departures at the lower-left say the left tail is heavier than normal (extra crash risk); departures at the upper-right say the right tail is heavier (extra rally risk). The two ends are where Gaussian VaR actually fails.

theoretical (normal) quantileobserved▼ left tail (extra losses)▲ right tail (extra gains)

5.Autocorrelation: efficient-market & ARCH

Three autocorrelation panels tell three different stories. The ACF of rtr_ttests whether returns themselves are predictable — efficient-market theory says they shouldn't be, and they typically aren't. The ACF of rt|r_t| and rt2r_t^2 tests for volatility clustering: even though returns are unpredictable, their magnitudeis highly autocorrelated. That's the textbook motivation for any ARCH-family model.

ρk=t=k+1n(xtxˉ)(xtkxˉ)t=1n(xtxˉ)2,95% band: ρk<1.96n.\rho_k = \frac{\sum_{t=k+1}^{n}(x_t - \bar x)(x_{t-k} - \bar x)}{\sum_{t=1}^{n}(x_t - \bar x)^2}, \quad \text{95\% band: } |\rho_k| < \frac{1.96}{\sqrt n}.

ACF of r_t (efficient-market check)

0.31-0.19lag k±1.96 / √N significance bandshould be inside the gold band

ACF of |r_t| (volatility clustering)

0.42-0.19lag k±1.96 / √N significance bandbars outside the band = persistent vol

ACF of r_t² (ARCH effects)

0.33-0.19lag k±1.96 / √N significance bandconfirms a non-constant variance

6.Stationarity in the second moment

The rolling 60-day annualised mean and standard deviation make the regime structure visible. A stationary series has both lines hovering around their long-run averages; a non-stationary one has the volatility wandering across regimes. For commodities, the latter is the rule.

— rolling mean (annualised)— rolling σ (annualised)observation idx80%-345%

7.Findings

Six tests, each with its own per-asset value and verdict. The point isn't to fail facts — most pass on most assets — it's to document that we checked.

Fat tails (excess kurtosis > 0)

143.94

Heavy tails — Gaussian VaR understates risk.

Gain/loss asymmetry (skewness ≠ 0)

-10.011

Left-skewed: crashes outsize the rallies.

Volatility clustering ( |r| autocorr )

0.121

Strong clustering — GARCH-style vol model warranted.

Squared returns autocorr

0.032

Weak ARCH evidence.

Weak return autocorrelation (efficient market)

-0.005

Returns near white-noise as efficient-market theory predicts.

Returns stationary (ADF t-stat < −2.89)

-25.01

Returns are stationary at 5%. Levels would not be.

Part III · VaR method comparison

8.Gaussian (the baseline)

The textbook VaR at level α\alpha under a Gaussian return assumption is VaRα=(μ+zασ)\mathrm{VaR}_\alpha = -(\mu + z_\alpha \sigma) where zα=Φ1(1α)z_\alpha = \Phi^{-1}(1-\alpha). Quick, closed-form, and wrong in either tail of any real-world return series.

VaRαG=(μ+zασ)\mathrm{VaR}_\alpha^{\text{G}} = -\left(\mu + z_\alpha\,\sigma\right)

9.Cornish-Fisher (Edgeworth correction)

Cornish-Fisher replaces the Gaussian quantile zαz_\alpha with a polynomial adjustment that absorbs skewness and excess kurtosis.

zαCF=zα+(zα21)6γ1+(zα33zα)24γ2(2zα35zα)36γ12z_\alpha^{CF} = z_\alpha + \tfrac{(z_\alpha^2 - 1)}{6}\gamma_1 + \tfrac{(z_\alpha^3 - 3 z_\alpha)}{24}\gamma_2 - \tfrac{(2 z_\alpha^3 - 5 z_\alpha)}{36}\gamma_1^2

For a left-skewed, heavy-tailed return series the cubic in zαz_\alpha pushes the quantile further into the tail than Gaussian, so VaRαCF>VaRαG\mathrm{VaR}_\alpha^{CF} > \mathrm{VaR}_\alpha^{\text{G}}. On this asset the empirical γ1=10.011\gamma_1 = -10.011, γ2=143.94\gamma_2 = 143.94 drive that correction directly.

10.Filtered Historical Simulation

FHS sits between parametric and non-parametric. The recipe:

  1. Estimate a volatility model — here EWMA with λ from MLE.
  2. Compute standardised returns r~t=rt/σ^t\tilde r_t = r_t / \hat\sigma_t.
  3. Read the empirical (1α)(1-\alpha) quantile q1αq_{1-\alpha} from the standardised distribution.
  4. Scale back: VaRαFHS=q1ασ^T\mathrm{VaR}_\alpha^{\text{FHS}} = -q_{1-\alpha} \cdot \hat\sigma_T.

The non-parametric quantile lets the actual tail shape speak; the EWMA scale lets the vol model react to recent days. Glasserman calls this “the right compromise between Gauss and history.”

11.All three, on the same histogram

The cleanest way to see how the three methods disagree is to draw all three thresholds on the same returns distribution and slide the confidence level around. At low α\alpha the three almost coincide. As α\alpha approaches 99% the gap widens — and whichever method is most conservative on this asset is the one that was best aware of the tail.

α = 95% · z_α = -1.645

50%99.5%
G 2.8%CF -0.3%FHS 1.5%-26.9%3.8%— normal( μ, σ )

Each dashed line is a VaR threshold at the chosen α. Drag the slider toward 99% and watch how the three methods diverge — that gap is the skew-and-kurtosis effect.

12.Numerical comparison

MethodVaR 95%CVaR 95%VaR 99%CVaR 99%
Gaussianrecommended2.79%3.45%3.87%4.41%
Cornish-Fisher0.31%9.83%9.12%9.58%
FHS1.19%4.47%1.84%16.18%

Part IV · VaR backtest (Kupiec + Christoffersen)

13.Why backtest a VaR at all

Reporting VaR0.95\mathrm{VaR}_{0.95} without checking how often the realised loss exceeded it is the cardinal sin of risk reporting. A correct VaR model breaches at exactly the unconditional rate p=1αp = 1 - \alpha, and the breaches should be independent in time. Kupiec (1995) and Christoffersen (1998) gave us likelihood-ratio tests for both properties.

14.Kupiec POF (unconditional coverage)

With xx breaches in nn days, the empirical breach rate is p^=x/n\hat p = x/n. The LR statistic is χ2(1)\chi^2(1) under the null that p^=p\hat p = p.

LRuc=2log[(1p)nxpx(1p^)nxp^x]χ2(1)\mathrm{LR}_{\text{uc}} = -2\log\left[\frac{(1-p)^{n-x}\,p^x}{(1-\hat p)^{n-x}\,\hat p^x}\right] \sim \chi^2(1)

High p-value means we cannot reject correct coverage; low p-value means the breach rate differs from the target in a way that can't be explained by sampling noise.

15.Christoffersen (independence)

Even when the total breach count is right, breaches that cluster signal a vol model too slow to react. Christoffersen builds a 2×2 transition table over the breach indicator and tests whether P(breachtbreacht1)=P(breachtno breacht1)P(\text{breach}_t \mid \text{breach}_{t-1}) = P(\text{breach}_t \mid \text{no breach}_{t-1}).

LRind=2logL(π)L(π01,π11)χ2(1)\mathrm{LR}_{\text{ind}} = -2\log\frac{L(\pi)}{L(\pi_{01}, \pi_{11})} \sim \chi^2(1)

with πij\pi_{ij} the empirical transition rates from state ii (no breach / breach) to state jj. The combined conditional-coverage test adds the two LRs and tests against χ2(2)\chi^2(2) — both at once.

16.Results on this asset

Run on a rolling 60-day window with the recommended VaR method:

95% confidence

n = 561

Breaches

41

expected 28.1

Breach rate

7.31%

target 5%

  • Kupiec POF

    unconditional coverage

    LR = 5.54p = 0.019
  • Christoffersen

    breach independence

    LR = 0.00p = 0.999
  • Combined CC

    conditional coverage

    LR = 5.54p = 0.063

99% confidence

n = 561

Breaches

15

expected 5.6

Breach rate

2.67%

target 1%

  • Kupiec POF

    unconditional coverage

    LR = 10.88p = 0.001
  • Christoffersen

    breach independence

    LR = 0.68p = 0.410
  • Combined CC

    conditional coverage

    LR = 11.56p = 0.003

17.Breach timeline

Each blue tick is a day with no breach; gold dots trace the negative of the VaR threshold; red ticks are breaches. Clustered red ticks are what Christoffersen catches.

loss →2026-06-012024-07-05

18.Year-by-year breach distribution

Counting breaches per calendar year against the expected rate makes regime episodes obvious. Bars in green sit at or below the gold expected-rate tick; bars in red overshoot.

24825232610— expected at α = 95%▮ at or below expected▮ exceeds expected

Data: Supabase + GitHub Actions ETL · last update 2026-06-01