Skip to content
Try Hanzo
Language: English (United States)

DAIR Emotion

Benchmarks / Kai / DAIR Emotion

Kai · Decision harness

Kai and Jev on the same 400 questions of DAIR Emotion, one run per Kai revision.

Accuracy

History

12 results across 2 metrics, newest first. Superseded runs stay, so a revision's progress can be read.

History
MeasuredSubjectMetricValueBaselineResultStatus
Oct 16, 2026kai-1.4 · c1856a77Accuracy92.3%Jev 60.3%WinLive · Hanzo-measured
Oct 16, 2026kai-1.4 · c1856a77Calibration error (ECE)0.033Jev 0.280WinLive · Hanzo-measured
Oct 3, 2026kai-1 · 0834a74fAccuracy93.5%Jev 60.3%WinSuperseded · Hanzo-measured
Oct 3, 2026kai-1 · 0834a74fCalibration error (ECE)0.018Jev 0.280WinSuperseded · Hanzo-measured
Sep 28, 2026Kai a8 · 0cfeef05Accuracy93.8%Jev 60.3%WinSuperseded · Hanzo-measured
Sep 28, 2026Kai a7 · 0834a74fAccuracy93.5%Jev 60.3%WinSuperseded · Hanzo-measured
Sep 28, 2026Kai a6 · a211cc70Accuracy93.5%Jev 60.3%WinSuperseded · Hanzo-measured
Sep 28, 2026Kai a8 · 0cfeef05Calibration error (ECE)0.023Jev 0.280WinSuperseded · Hanzo-measured
Sep 28, 2026Kai a7 · 0834a74fCalibration error (ECE)0.019Jev 0.280WinSuperseded · Hanzo-measured
Sep 28, 2026Kai a6 · a211cc70Calibration error (ECE)0.025Jev 0.280WinSuperseded · Hanzo-measured
Sep 27, 2026Kai a5 · df1c16a2Accuracy92.5%Jev 60.3%WinSuperseded · Hanzo-measured
Sep 27, 2026Kai a5 · df1c16a2Calibration error (ECE)0.041Jev 0.280WinSuperseded · Hanzo-measured

Conditions

  • split: harness
  • 400 questions, 400 answered
  • dataset dde140a63fc5
  • 6 Kai revisions measured
  • Jev: typesafe/jev-1.13-20260917, measured Sep 25, 2026

Hardware

CPU AS SERVED

Reproduce

bench score --harness . --kai results/kai/preds.json.gz --out results/scores.json # in hanzoai/benchmarks/decision @ 5f616dd

GET api.hanzo.ai/v1/research/runs?org=hanzo&id=jev.emotion-harness-kai-1.4.c1856a77-kai

{ "data": [
  "jev.emotion-harness-kai-1.4.c1856a77-kai"
] }
Kai a5 · df1c16a2  92.5%
Kai a8 · 0cfeef05  93.8%
Kai a7 · 0834a74f  93.5%
Kai a6 · a211cc70  93.5%
kai-1 · 0834a74f  93.5%
kai-1.4 · c1856a77  92.3%