Public bake-off · rerank

Best small model for Rerank passages by relevance to the query

Winner: cross-encoder/ms-marco-TinyBERT-L2-v2 incumbent

Resident family incumbents were compared on the submitted labels.

Bake-off bo_29d74d5a961d847259cf3f2595d5824f · 2026-08-19T19:37:22.115212Z

Are you the winning model’s author?

Add this exact line to the winner’s public Hugging Face README.md, then call the claim endpoint with its repo id.

Bay-Run-Claim: bo_29d74d5a961d847259cf3f2595d5824f · sha256:01083d5eeb8d6761dc768872782c197b6c891f5fdb8b1cbc90a16ae8e2d9c1c0

Scorecard

Rank	Model	Metrics	Predicted vs expected	Latency	Status
1	`cross-encoder/ms-marco-TinyBERT-L2-v2`incumbentwinner	hit@5 1.0mrr 1.0ndcg@5 1.0	Not retained	122 ms	scored
2	`cross-encoder/ms-marco-MiniLM-L4-v2`incumbent	hit@5 1.0mrr 1.0ndcg@5 1.0	Not retained	302 ms	scored

Signed receipt

This result is bound to its task, candidates, scorecard, and winner.

sha256:01083d5eeb8d6761dc768872782c197b6c891f5fdb8b1cbc90a16ae8e2d9c1c0

Winner badge

Copy-paste Markdown:

[![Bay Run bake-off winner · receipted](https://run.huggingbay.xyz/bakeoffs/bo_29d74d5a961d847259cf3f2595d5824f/badge.svg)](https://run.huggingbay.xyz/bakeoffs/bo_29d74d5a961d847259cf3f2595d5824f)

Reproduce it

The first bake-off is anonymous. Run the same labeled request directly:

curl -sS https://run.huggingbay.xyz/v1/bakeoff -H 'Content-Type: application/json' --data '{"task_description":"Rerank passages by relevance to the query","examples":[{"input":"How tall is the Eiffel Tower?","expected":"The Eiffel Tower is 330 metres tall."},{"input":"What is the capital of France?","expected":"Paris is the capital of France."},{"input":"Who wrote Hamlet?","expected":"William Shakespeare wrote the play Hamlet."},{"input":"What is the boiling point of water?","expected":"Water boils at 100 degrees Celsius at sea level."}]}'