Cyvia Research: notes from the lab, published as we learn
← All research
Benchmarks & evals

Every benchmark, with the method attached.

Head-to-head results and rolling evals, each published with its corpus, its setup, and the parts we did not test. We refresh these as models and datasets move.

✓ Thanks — you're on the list.

CLASSIFICATION★ LIVE · 30 JUL
Head to head with a leading platform

PII detection & classification across prompt and output surfaces, on a mixed India & ANZ dataset.

+19.1pp
micro recall
95.0%
F1 score
5.6×
faster
Full table & methodRead →
INTENT DETECTIONEVAL IN PROGRESS
Campaign-level intent vs. per-prompt guardrails

Recall on multi-turn jailbreak campaigns, measured against single-prompt classifiers. Publishing with the attack set.

Expected Q3 2026
AGENTIC RISKEVAL IN PROGRESS
Plan-level exfiltration & poisoning catch rate

How often plan-level checks stop a poisoned instruction before it executes, versus content filtering on the output.

Expected Q3 2026
COST & LATENCYEVAL IN PROGRESS
Cascade cost curve at corpus scale

Compute and latency per million documents as the cascade routes cases, benchmarked against a single frontier pass.

Expected Q4 2026

One benchmark live, more in flight. We publish each with its dataset and its limits as it lands.

Get the lab notes as we publish them.

Benchmarks, intent research, and the attacks we catch in real corpora. No noise, just what we find while building.

✓ Thanks — you're on the list.