My biggest release of the year: a series of 7 specialized embedding models for information retrieval within tax documents, is now available for free on Hugging Face 🤗
text
My biggest release of the year: a series of 7 specialized embedding models for information retrieval within tax documents, is now available for free on Hugging Face 🤗
new_line
new_line
These new models aim to offer an open source alternative for in-domain semantic search from large text corpora and will improve RAG systems and context addition for large language models.
text
These new models aim to offer an open source alternative for in-domain semantic search from large text corpora and will improve RAG systems and context addition for large language models.
new_line
new_line
Trained on more than 43 million tax tokens derived from semi-synthetic and raw-synthetic data, enriched by various methods (in particular MSFT's evol-instruct by 
text
Trained on more than 43 million tax tokens derived from semi-synthetic and raw-synthetic data, enriched by various methods (in particular MSFT's evol-instruct by 
@intfloat
mention
intfloat
), and corrected by humans, this project is the fruit of hundreds of hours of work and is the culmination of a global effort to open up legal technologies that has only just begun.
text
), and corrected by humans, this project is the fruit of hundreds of hours of work and is the culmination of a global effort to open up legal technologies that has only just begun.
new_line
new_line
A big thank you to Microsoft for Startups for giving me access to state-of-the-art infrastructure to train these models, and to 
text
A big thank you to Microsoft for Startups for giving me access to state-of-the-art infrastructure to train these models, and to 
@julien-c
mention
julien-c
, 
text
, 
@clem
mention
clem
  🤗, 
text
  🤗, 
@thomwolf
mention
thomwolf
 and the whole HF team for the inference endpoint API and the generous provision of Meta LLama-3.1-70B. Special thanks also to 
text
 and the whole HF team for the inference endpoint API and the generous provision of Meta LLama-3.1-70B. Special thanks also to 
@tomaarsen
mention
tomaarsen
 for his invaluable advice on training embedding models and Loss functions ❤️
text
 for his invaluable advice on training embedding models and Loss functions ❤️
new_line
new_line
Models are available on my personal HF page, into the Lemone-embed collection: 
text
Models are available on my personal HF page, into the Lemone-embed collection: 
https://huggingface.co/collections/louisbrulenaudet/lemone-embed-66fdc24000df732b395df29b
louisbrulenaudet/lemone-embed-66fdc24000df732b395df29b
collection
resource
https://huggingface.co/collections/louisbrulenaudet/lemone-embed-66fdc24000df732b395df29b
My biggest release of the year: a series of 7 specialized embedding models for information retrieval within tax documents, is now available for free on Hugging Face 🤗

These new models aim to offer an open source alternative for in-domain semantic search from large text corpora and will improve RAG systems and context addition for large language models.

Trained on more than 43 million tax tokens derived from semi-synthetic and raw-synthetic data, enriched by various methods (in particular MSFT's evol-instruct by @intfloat), and corrected by humans, this project is the fruit of hundreds of hours of work and is the culmination of a global effort to open up legal technologies that has only just begun.

A big thank you to Microsoft for Startups for giving me access to state-of-the-art infrastructure to train these models, and to @julien-c, @clem  🤗, @thomwolf and the whole HF team for the inference endpoint API and the generous provision of Meta LLama-3.1-70B. Special thanks also to @tomaarsen for his invaluable advice on training embedding models and Loss functions ❤️

Models are available on my personal HF page, into the Lemone-embed collection: https://huggingface.co/collections/louisbrulenaudet/lemone-embed-66fdc24000df732b395df29b
❤️
tomaarsen clem yashisfine sensei-ml John6666 a9i Tonic julien-c
👍
ijohn07
66b231d91228888a8c0cde86
/avatars/8ec411454fed4bd214fc1676de533a1c.svg
yash negi
yashisfine
user