Bay Run · warm-family model lab

Public bake-off · classify

Best small model for Classify the sentiment of a customer message as positive or negative

Winner: distilbert/distilbert-base-uncased-finetuned-sst-2-english incumbent

Resident family incumbents were compared on the submitted labels.

Bake-off bo_e8517bc70328d83f4a8afe69e30f2f13 ·

Are you the winning model’s author?

Add this exact line to the winner’s public Hugging Face README.md, then call the claim endpoint with its repo id.

Bay-Run-Claim: bo_e8517bc70328d83f4a8afe69e30f2f13 · sha256:0638b50aee7c6d49bbe4ac348478d44ae4cc73950dbf265a3e77aae11e345a7b

Scorecard

RankModelMetricsPredicted vs expectedLatencyStatus
1distilbert/distilbert-base-uncased-finetuned-sst-2-englishincumbentwinneraccuracy 1.0macro_f1 1.0n 4
  1. match positive vs positive
  2. match negative vs negative
  3. match positive vs positive
  4. match negative vs negative
154 msscored
2lxyuan/distilbert-base-multilingual-cased-sentiments-studentincumbentaccuracy 1.0macro_f1 1.0n 4
  1. match positive vs positive
  2. match negative vs negative
  3. match positive vs positive
  4. match negative vs negative
236 msscored

Signed receipt

This result is bound to its task, candidates, scorecard, and winner.

sha256:0638b50aee7c6d49bbe4ac348478d44ae4cc73950dbf265a3e77aae11e345a7b

Winner badge

Bay Run bake-off winner badge

Copy-paste Markdown:

[![Bay Run bake-off winner · receipted](https://run.huggingbay.xyz/bakeoffs/bo_e8517bc70328d83f4a8afe69e30f2f13/badge.svg)](https://run.huggingbay.xyz/bakeoffs/bo_e8517bc70328d83f4a8afe69e30f2f13)

Reproduce it

The first bake-off is anonymous. Run the same labeled request directly:

curl -sS https://run.huggingbay.xyz/v1/bakeoff -H 'Content-Type: application/json' --data '{"task_description":"Classify the sentiment of a customer message as positive or negative","examples":[{"input":"I love this, it works perfectly","expected":"positive"},{"input":"This broke after two days and support ignored me","expected":"negative"},{"input":"Absolutely fantastic","expected":"positive"},{"input":"Awful, would not recommend","expected":"negative"}]}'