The Romulus model series has been released on Hugging Face, continually pre-trained on 34,864,949 tokens of French laws and intended to serve as a foundation for fine-tuning on labeled data 🤗
text
The Romulus model series has been released on Hugging Face, continually pre-trained on 34,864,949 tokens of French laws and intended to serve as a foundation for fine-tuning on labeled data 🤗
new_line
new_line
The training code, dataset and model weights are open and available free on HF and the training was based on H100 provided by Microsoft for Startups using Unsloth AI by 
text
The training code, dataset and model weights are open and available free on HF and the training was based on H100 provided by Microsoft for Startups using Unsloth AI by 
@danielhanchen
mention
danielhanchen
 and 
text
 and 
@shimmyshimmer
mention
shimmyshimmer
  🦥
text
  🦥
new_line
new_line
Link to the base model: 
text
Link to the base model: 
https://huggingface.co/louisbrulenaudet/Romulus-cpt-Llama-3.1-8B-v0.1
louisbrulenaudet/Romulus-cpt-Llama-3.1-8B-v0.1
model
resource
https://huggingface.co/louisbrulenaudet/Romulus-cpt-Llama-3.1-8B-v0.1
new_line
new_line
Link to the instruct model: 
text
Link to the instruct model: 
https://huggingface.co/louisbrulenaudet/Romulus-cpt-Llama-3.1-8B-v0.1-Instruct
louisbrulenaudet/Romulus-cpt-Llama-3.1-8B-v0.1-Instruct
model
resource
https://huggingface.co/louisbrulenaudet/Romulus-cpt-Llama-3.1-8B-v0.1-Instruct
new_line
new_line
Link to the dataset: 
text
Link to the dataset: 
https://huggingface.co/datasets/louisbrulenaudet/Romulus-cpt-fr
louisbrulenaudet/Romulus-cpt-fr
dataset
resource
https://huggingface.co/datasets/louisbrulenaudet/Romulus-cpt-fr
new_line
new_line
Please note that these models have not been aligned for the production of usable texts as they stand, and will certainly need to be refined for the desired tasks in order to produce satisfactory results.
text
Please note that these models have not been aligned for the production of usable texts as they stand, and will certainly need to be refined for the desired tasks in order to produce satisfactory results.
The Romulus model series has been released on Hugging Face, continually pre-trained on 34,864,949 tokens of French laws and intended to serve as a foundation for fine-tuning on labeled data 🤗

The training code, dataset and model weights are open and available free on HF and the training was based on H100 provided by Microsoft for Startups using Unsloth AI by @danielhanchen and @shimmyshimmer  🦥

Link to the base model: https://huggingface.co/louisbrulenaudet/Romulus-cpt-Llama-3.1-8B-v0.1

Link to the instruct model: https://huggingface.co/louisbrulenaudet/Romulus-cpt-Llama-3.1-8B-v0.1-Instruct

Link to the dataset: https://huggingface.co/datasets/louisbrulenaudet/Romulus-cpt-fr

Please note that these models have not been aligned for the production of usable texts as they stand, and will certainly need to be refined for the desired tasks in order to produce satisfactory results.
🔥
danielhanchen kramp osanseviero gabrielmbmb ashutoshzade Gatozu35 lucianosb lastdefiance20
👀
John6666 danielhanchen
❤️
danielhanchen
👍
Tom-Neverwinter
62ecdc18b72a69615d6bd857
https://cdn-avatars.huggingface.co/v1/production/uploads/62ecdc18b72a69615d6bd857/qAHhWJbSsmoezFHiErBUT.png
Daniel (Unsloth)
danielhanchen
user