Create and Train Your Own Expert LLM: Generating Synthetic, Fact-Based Datasets with LMStudio/Ollama and then fine-tuning with MLX and Unsloth
text
Create and Train Your Own Expert LLM: Generating Synthetic, Fact-Based Datasets with LMStudio/Ollama and then fine-tuning with MLX and Unsloth
new_line
new_line
Hey everyone!
text
Hey everyone!
new_line
new_line
I know there are tons of videos and tutorials out there already but I've noticed a lot of questions popping up in community posts about using synthetic datasets for creative projects and how to transform personal content into more factual material. In my own work doing enterprise-level SFT and crafting my open-source models, I've enhanced a Python framework originally shared by the creator of the Tess models. This improved stack utilizes local language models and also integrates the Wikipedia dataset to ensure that the content generated is as accurate and reliable as possible.
text
I know there are tons of videos and tutorials out there already but I've noticed a lot of questions popping up in community posts about using synthetic datasets for creative projects and how to transform personal content into more factual material. In my own work doing enterprise-level SFT and crafting my open-source models, I've enhanced a Python framework originally shared by the creator of the Tess models. This improved stack utilizes local language models and also integrates the Wikipedia dataset to ensure that the content generated is as accurate and reliable as possible.
new_line
new_line
I've been thinking of putting together a comprehensive, step-by-step course/guide on creating your own Expert Language Model. From dataset preparation and training to deployment on Hugging Face and even using something like AnythingLLM for user interaction. I'll walk you through each phase, clarifying complex concepts and troubleshooting common pitfalls.
text
I've been thinking of putting together a comprehensive, step-by-step course/guide on creating your own Expert Language Model. From dataset preparation and training to deployment on Hugging Face and even using something like AnythingLLM for user interaction. I'll walk you through each phase, clarifying complex concepts and troubleshooting common pitfalls.
new_line
new_line
Let me know if this interests you!
text
Let me know if this interests you!
new_line
new_line
Most of the datasets and models I've made have been using these scripts and my approach
text
Most of the datasets and models I've made have been using these scripts and my approach
Create and Train Your Own Expert LLM: Generating Synthetic, Fact-Based Datasets with LMStudio/Ollama and then fine-tuning with MLX and Unsloth

Hey everyone!

I know there are tons of videos and tutorials out there already but I've noticed a lot of questions popping up in community posts about using synthetic datasets for creative projects and how to transform personal content into more factual material. In my own work doing enterprise-level SFT and crafting my open-source models, I've enhanced a Python framework originally shared by the creator of the Tess models. This improved stack utilizes local language models and also integrates the Wikipedia dataset to ensure that the content generated is as accurate and reliable as possible.

I've been thinking of putting together a comprehensive, step-by-step course/guide on creating your own Expert Language Model. From dataset preparation and training to deployment on Hugging Face and even using something like AnythingLLM for user interaction. I'll walk you through each phase, clarifying complex concepts and troubleshooting common pitfalls.

Let me know if this interests you!

Most of the datasets and models I've made have been using these scripts and my approach
👍
edumunozsala SmartGoldfish rizwanalvi1 HeRksTAn algorithm aimillsapps KingNish Dlbk win10 Stefan171 shivamgpt Ayeleth iweavings Clausss kid502 Deepankar27 krishnamishra94 Taylor658 victor Nioi ajibawa-2023 nivram189 pedi ShahabVFX ahmedzx AtAndDev alt2023 schlafen
❤️
afkfatih algorithm MultiTrickFox raincandy-u victor nivram189 pedi LeroyDyer ahmedzx AtAndDev GaelicThunder
🚀
HeRksTAn algorithm victor nivram189 pedi AtAndDev Norod78
🔥
algorithm victor nivram189 pedi AtAndDev
😎
algorithm victor nivram189 AtAndDev
642d678777078db98b729188
https://cdn-avatars.huggingface.co/v1/production/uploads/642d678777078db98b729188/lYhIEChF4qQG8ltRF3ECw.png
algorithm
algorithm
user
62ec82aaaefff8bcb1336b87
https://cdn-avatars.huggingface.co/v1/production/uploads/62ec82aaaefff8bcb1336b87/1_-oJrfuFTSiHnYv1eBPr.jpeg
Malich Coory
IndrasMirror
user
640720285e6d06cc2cf346e4
https://cdn-avatars.huggingface.co/v1/production/uploads/640720285e6d06cc2cf346e4/p-U1ON7ZPNntBAnOo8FCE.png
ZINWIN(Zuojun-Ye)
win10
user
65d883893a52cd9bcd8ab7cf
https://cdn-avatars.huggingface.co/v1/production/uploads/65d883893a52cd9bcd8ab7cf/tRsCJlHNZo1D02kBTmfy9.jpeg
leroy Samuel Dyer
LeroyDyer
user
646d811eeb9268aeebc4bfeb
https://cdn-avatars.huggingface.co/v1/production/uploads/646d811eeb9268aeebc4bfeb/lbGHopd87wkB-TL1rCZHR.jpeg
iweavings
iweavings
user
657eb5b256c9c67605a6e8b5
https://cdn-avatars.huggingface.co/v1/production/uploads/657eb5b256c9c67605a6e8b5/RPblnGJX57oiIcASEz_S8.png
raincandy_U
raincandy-u
user
64e9d0e364619253012c8e64
/avatars/dbd21f8d0624422f232aa0d788e6838b.svg
yy
capti0n
user
66390a72c9648d0612488340
/avatars/09d248a6f220819763c810a73a324e8c.svg
rshee
pedi
user
663921b95cbebc0a7755244d
/avatars/5a1845b56a7489e029b200d92d7958be.svg
Ahmed Moawad 
ahmedzx
user
630f3e4002ce39336c411048
https://cdn-avatars.huggingface.co/v1/production/uploads/630f3e4002ce39336c411048/Dbb855C55XdPd3rRH9auc.jpeg
alkinun
AtAndDev
user