Public bake-off · classify
Weak field for Classify support tickets by workflow
Top measured: cross-encoder/nli-deberta-v3-xsmall incumbent
Weak field. The top measured accuracy did not clear the public 0.60/chance gate. This page makes no best-model, badge, or author claim.
Bake-off bo_c3eea1a4d7585604b2d2de3a9e08dfdf ·
Scorecard
| Rank | Model | Metrics | Predicted vs expected | Latency | Status |
|---|---|---|---|---|---|
| 1 | cross-encoder/nli-deberta-v3-xsmallincumbent | accuracy 0.4macro_f1 0.4n 5 | Not retained | 1297 ms | scored |
| 2 | distilbert/distilbert-base-uncased-finetuned-sst-2-englishincumbent | accuracy 0.0macro_f1 0.0n 5 | Not retained | 166 ms | scored |
| 3 | cardiffnlp/twitter-roberta-base-sentiment-latestincumbent | accuracy 0.0macro_f1 0.0n 5 | Not retained | 10952 ms | scored |
Signed receipt
This result is bound to its task, candidates, scorecard, and winner.
sha256:2ed7a571397819b9816987f98c547c08e811a423afa1d4a2bcf20f14f239da4e
Reproduce it
The first bake-off is anonymous. Run the same labeled request directly:
curl -sS https://run.huggingbay.xyz/v1/bakeoff -H 'Content-Type: application/json' --data '{"task_description":"Classify support tickets by workflow","examples":[{"input":"Cannot sign in","expected":"access_issue"},{"input":"Refund the invoice","expected":"billing_issue"},{"input":"Shipment is late","expected":"delivery_issue"},{"input":"Setup is complete","expected":"account_update"},{"input":"Order is damaged","expected":"fulfillment_issue"}]}'