Pointwise Gaggle!
Collection
4 items β’ Updated β’ 1
How to use castorini/monot5-3b-msmarco-10k with Transformers:
# Load model directly
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
tokenizer = AutoTokenizer.from_pretrained("castorini/monot5-3b-msmarco-10k")
model = AutoModelForSeq2SeqLM.from_pretrained("castorini/monot5-3b-msmarco-10k")YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
This model is a T5-3B reranker fine-tuned on the MS MARCO passage dataset for 10k steps (or 1 epoch).
For more details on how to use it, check pygaggle.ai
Paper describing the model: Document Ranking with a Pretrained Sequence-to-Sequence Model
This model is also the state of the art on the BEIR Benchmark.