Bay Run · warm-family model lab

Public bake-off · classify

Best small model for Classify the sentiment of a customer message as positive or negative

Winner: distilbert/distilbert-base-uncased-finetuned-sst-2-english incumbent

Resident family incumbents were compared on the submitted labels.

Bake-off bo_cc6232f5ae64f81ad6687be4bc4a3c01 ·

Are you the winning model’s author?

Add this exact line to the winner’s public Hugging Face README.md, then call the claim endpoint with its repo id.

Bay-Run-Claim: bo_cc6232f5ae64f81ad6687be4bc4a3c01 · sha256:61807ce6a33b5f9992f5e1095978a5f9affb615e293b8d63f85112257c0a0df9

Scorecard

RankModelMetricsPredicted vs expectedLatencyStatus
1distilbert/distilbert-base-uncased-finetuned-sst-2-englishincumbentwinneraccuracy 1.0macro_f1 1.0n 4
  1. match positive vs positive
  2. match negative vs negative
  3. match positive vs positive
  4. match negative vs negative
917 msscored
2lxyuan/distilbert-base-multilingual-cased-sentiments-studentincumbentaccuracy 1.0macro_f1 1.0n 4
  1. match positive vs positive
  2. match negative vs negative
  3. match positive vs positive
  4. match negative vs negative
920 msscored

Signed receipt

This result is bound to its task, candidates, scorecard, and winner.

sha256:61807ce6a33b5f9992f5e1095978a5f9affb615e293b8d63f85112257c0a0df9

Winner badge

Bay Run bake-off winner badge

Copy-paste Markdown:

[![Bay Run bake-off winner · receipted](https://run.huggingbay.xyz/bakeoffs/bo_cc6232f5ae64f81ad6687be4bc4a3c01/badge.svg)](https://run.huggingbay.xyz/bakeoffs/bo_cc6232f5ae64f81ad6687be4bc4a3c01)

Reproduce it

The first bake-off is anonymous. Run the same labeled request directly:

curl -sS https://run.huggingbay.xyz/v1/bakeoff -H 'Content-Type: application/json' --data '{"task_description":"Classify the sentiment of a customer message as positive or negative","examples":[{"input":"I love this, it works perfectly","expected":"positive"},{"input":"This broke after two days and support ignored me","expected":"negative"},{"input":"Absolutely fantastic experience","expected":"positive"},{"input":"Terrible, would not recommend","expected":"negative"}]}'