Public bake-off · classify

Best small model for route customer emails

Winner: cross-encoder/nli-deberta-v3-xsmall incumbent

Resident family incumbents were compared on the submitted labels.

Bake-off bo_38daf1d72bbd5f963f630b8f52a58b06 · 2026-08-18T00:37:05.244992Z

Are you the winning model’s author?

Add this exact line to the winner’s public Hugging Face README.md, then call the claim endpoint with its repo id.

Bay-Run-Claim: bo_38daf1d72bbd5f963f630b8f52a58b06 · sha256:a5e25850a78b3a979e7d98c4465191133e2b3af3deda4a9fd999e6a070e6f91b

Scorecard

Rank	Model	Metrics	Predicted vs expected	Latency	Status
1	`cross-encoder/nli-deberta-v3-xsmall`incumbentwinner	accuracy 1.0macro_f1 1.0n 5	Not retained	797 ms	scored
2	`distilbert/distilbert-base-uncased-finetuned-sst-2-english`incumbent	accuracy 0.0macro_f1 0.0n 5	Not retained	77 ms	scored
3	`cardiffnlp/twitter-roberta-base-sentiment-latest`incumbent	accuracy 0.0macro_f1 0.0n 5	Not retained	1986 ms	scored

Signed receipt

This result is bound to its task, candidates, scorecard, and winner.

sha256:a5e25850a78b3a979e7d98c4465191133e2b3af3deda4a9fd999e6a070e6f91b

Winner badge

Copy-paste Markdown:

[![Bay Run bake-off winner · receipted](https://run.huggingbay.xyz/bakeoffs/bo_38daf1d72bbd5f963f630b8f52a58b06/badge.svg)](https://run.huggingbay.xyz/bakeoffs/bo_38daf1d72bbd5f963f630b8f52a58b06)

Reproduce it

The first bake-off is anonymous. Run the same labeled request directly:

curl -sS https://run.huggingbay.xyz/v1/bakeoff -H 'Content-Type: application/json' --data '{"task_description":"route customer emails","examples":[{"input":"refund me now","expected":"billing"},{"input":"love the product","expected":"praise"},{"input":"app crashes on login","expected":"bug"},{"input":"charge me twice?","expected":"billing"},{"input":"crashes every time","expected":"bug"}]}'