Bay Run · warm-family model lab

Public bake-off · classify

Best small model for Classify customer feedback by sentiment

Winner: cross-encoder/nli-deberta-v3-xsmall incumbent

Resident family incumbents were compared on the submitted labels.

Bake-off bo_6fc2705b22c8c8e5b1afc66b0ddaaa23 ·

Are you the winning model’s author?

Add this exact line to the winner’s public Hugging Face README.md, then call the claim endpoint with its repo id.

Bay-Run-Claim: bo_6fc2705b22c8c8e5b1afc66b0ddaaa23 · sha256:d99c431f0363aaa6417ffe07118b6b60a28d15f08e12387c2a20a68ae7163803

Scorecard

RankModelMetricsPredicted vs expectedLatencyStatus
1cross-encoder/nli-deberta-v3-xsmallincumbentwinneraccuracy 1.0macro_f1 1.0n 5
  1. match positive vs positive
  2. match negative vs negative
  3. match positive vs positive
  4. match negative vs negative
  5. match neutral vs neutral
1363 msscored
2typeform/distilbert-base-uncased-mnliincumbentaccuracy 1.0macro_f1 1.0n 5
  1. match positive vs positive
  2. match negative vs negative
  3. match positive vs positive
  4. match negative vs negative
  5. match neutral vs neutral
1003 msscored

Signed receipt

This result is bound to its task, candidates, scorecard, and winner.

sha256:d99c431f0363aaa6417ffe07118b6b60a28d15f08e12387c2a20a68ae7163803

Winner badge

Bay Run bake-off winner badge

Copy-paste Markdown:

[![Bay Run bake-off winner · receipted](https://run.huggingbay.xyz/bakeoffs/bo_6fc2705b22c8c8e5b1afc66b0ddaaa23/badge.svg)](https://run.huggingbay.xyz/bakeoffs/bo_6fc2705b22c8c8e5b1afc66b0ddaaa23)

Reproduce it

The first bake-off is anonymous. Run the same labeled request directly:

curl -sS https://run.huggingbay.xyz/v1/bakeoff -H 'Content-Type: application/json' --data '{"task_description":"Classify customer feedback by sentiment","examples":[{"input":"Setup took two minutes and works perfectly.","expected":"positive"},{"input":"The checkout is broken and I want a refund.","expected":"negative"},{"input":"I love how fast the search feels.","expected":"positive"},{"input":"This product is terrible and never arrived.","expected":"negative"},{"input":"Pretty average, nothing special.","expected":"neutral"}]}'