Hanzo AI
Try Hanzo

Benchmarks / Kai / DAIR Emotion

Kai · Decision harness

DAIR Emotion

Kai and Jev on the same 400 questions of DAIR Emotion, one run per Kai revision.

Latest

93.5%Accuracy · kai-1 · 0834a74fJev 60.3% · Win · Oct 3, 2026 · Hanzo-measured
0.018Calibration error (ECE) · kai-1 · 0834a74fJev 0.280 · Win · Oct 3, 2026 · Hanzo-measured

History

10 results across 2 metrics, newest first. Superseded runs stay, so a revision's progress can be read.

55%77%99%09-2709-2810-03Kai a5 · df1c16a2: 92.5%, Sep 27, 2026Kai a8 · 0cfeef05: 93.8%, Sep 28, 2026Kai a7 · 0834a74f: 93.5%, Sep 28, 2026Kai a6 · a211cc70: 93.5%, Sep 28, 2026kai-1 · 0834a74f: 93.5%, Oct 3, 2026
MeasuredSubjectMetricValueBaselineResultStatus
Oct 3, 2026kai-1 · 0834a74fAccuracy93.5%Jev 60.3%WinLive · Hanzo-measured
Oct 3, 2026kai-1 · 0834a74fCalibration error (ECE)0.018Jev 0.280WinLive · Hanzo-measured
Sep 28, 2026Kai a8 · 0cfeef05Accuracy93.8%Jev 60.3%WinSuperseded · Hanzo-measured
Sep 28, 2026Kai a7 · 0834a74fAccuracy93.5%Jev 60.3%WinSuperseded · Hanzo-measured
Sep 28, 2026Kai a6 · a211cc70Accuracy93.5%Jev 60.3%WinSuperseded · Hanzo-measured
Sep 28, 2026Kai a8 · 0cfeef05Calibration error (ECE)0.023Jev 0.280WinSuperseded · Hanzo-measured
Sep 28, 2026Kai a7 · 0834a74fCalibration error (ECE)0.019Jev 0.280WinSuperseded · Hanzo-measured
Sep 28, 2026Kai a6 · a211cc70Calibration error (ECE)0.025Jev 0.280WinSuperseded · Hanzo-measured
Sep 27, 2026Kai a5 · df1c16a2Accuracy92.5%Jev 60.3%WinSuperseded · Hanzo-measured
Sep 27, 2026Kai a5 · df1c16a2Calibration error (ECE)0.041Jev 0.280WinSuperseded · Hanzo-measured

Conditions

split: harness400 questions, 400 answereddataset dde140a63fc55 Kai revisions measuredJev: typesafe/jev-1.13-20260917, measured Sep 25, 2026

Hardware

CUDA BF16

Source

research run jev.emotion-harness-kai-1.0834a74f-kai

Reproduce

bench score --harness . --kai results/kai/preds.json.gz --out results/scores.json # in hanzoai/benchmarks/decision @ 2c74e2d

More Kai benchmarks

AG News · Banking77 · Support triage · Email spam · Phishing · Jailbreak · Toxicity · RAG relevance · Model routing · Typed decisions · MASSIVE · AG News, validation split · Support triage, validation split · Typed decisions, validation split · HarmBench (benign prompts) · Choosing among many options · Joint decisions · Release gate against Jev · Latency of one decision

Every result for DAIR Emotion on the shelf · How these are measured

Build what’s next.

Try HanzoRead the docs