Public bake-off · classify

Best small model for Classify customer feedback by sentiment

Winner: distilbert/distilbert-base-uncased-finetuned-sst-2-english incumbent

Resident family incumbents were compared on the submitted labels.

Bake-off bo_66d5cc2fd80c261712569556d43c19c4 ·

Are you the winning model’s author?

Add this exact line to the winner’s public Hugging Face README.md, then call the claim endpoint with its repo id.

Bay-Run-Claim: bo_66d5cc2fd80c261712569556d43c19c4 · sha256:237d3b2ea76f63fca1eff73dff558f2f512061cf5e32335a43d4f96c1b08eb12

Scorecard

RankModelMetricsPredicted vs expectedLatencyStatus
1distilbert/distilbert-base-uncased-finetuned-sst-2-englishincumbentwinneraccuracy 1.0macro_f1 1.0n 3
  1. match positive vs positive
  2. match negative vs negative
  3. match positive vs positive
156 msscored
2lxyuan/distilbert-base-multilingual-cased-sentiments-studentincumbentaccuracy 1.0macro_f1 1.0n 3
  1. match positive vs positive
  2. match negative vs negative
  3. match positive vs positive
161 msscored

Signed receipt

This result is bound to its task, candidates, scorecard, and winner.

sha256:237d3b2ea76f63fca1eff73dff558f2f512061cf5e32335a43d4f96c1b08eb12

Winner badge

Bay Run bake-off winner badge

Copy-paste Markdown:

[![Bay Run bake-off winner · receipted](https://run.huggingbay.xyz/bakeoffs/bo_66d5cc2fd80c261712569556d43c19c4/badge.svg)](https://run.huggingbay.xyz/bakeoffs/bo_66d5cc2fd80c261712569556d43c19c4)

Reproduce it

The first bake-off is anonymous. Run the same labeled request directly:

curl -sS https://run.huggingbay.xyz/v1/bakeoff -H 'Content-Type: application/json' --data '{"task_description":"Classify customer feedback by sentiment","examples":[{"input":"Setup took two minutes and works perfectly.","expected":"positive"},{"input":"The checkout is broken and I want a refund.","expected":"negative"},{"input":"I love how fast the search feels.","expected":"positive"}]}'