GPU Poor POV: Dont be Afraid :D
text
GPU Poor POV: Dont be Afraid :D
new_line
new_line
Sometimes we dont want to do something because of low self esteem,
text
Sometimes we dont want to do something because of low self esteem,
new_line
I ofter hear 'its to hard for me','i am not an expert','i do not know how to do it', etc. These  words are  never the truth,  we should not be afraid and try to build something because there is no additive value without a failure. 
text
I ofter hear 'its to hard for me','i am not an expert','i do not know how to do it', etc. These  words are  never the truth,  we should not be afraid and try to build something because there is no additive value without a failure. 
new_line
new_line
Same things comes in LLMs, there is a lot of fancy words happening, but whats is more important is that there are also  people who are constantly building so other can build.  Diving into finetuning LLMs is incredibly simple if we assume using axolotl library and pretrains stored on huggingface. 
text
Same things comes in LLMs, there is a lot of fancy words happening, but whats is more important is that there are also  people who are constantly building so other can build.  Diving into finetuning LLMs is incredibly simple if we assume using axolotl library and pretrains stored on huggingface. 
new_line
new_line
All we need is an idea, our GPU Poor desktop or colab notebooks and these steps:
text
All we need is an idea, our GPU Poor desktop or colab notebooks and these steps:
new_line
git clone https://github.com/OpenAccess-AI-Collective/axolotl
cd axolotl

pip3 install packaging
pip3 install -e '.[flash-attn,deepspeed]'
```
git clone https://github.com/OpenAccess-AI-Collective/axolotl
cd axolotl

pip3 install packaging
pip3 install -e '.[flash-attn,deepspeed]'
```
code_fence
new_line
After installation process we can go to examples, and modify configs to our own needs. 
text
After installation process we can go to examples, and modify configs to our own needs. 
new_line
Lets jump into 
text
Lets jump into 
new_line
axolotl\examples\llama-2\qlora.yml 
```
axolotl\examples\llama-2\qlora.yml 
```
code_fence
new_line
and change 
text
and change 
new_line
base_model: NousResearch/Llama-2-7b-hf
```
base_model: NousResearch/Llama-2-7b-hf
```
code_fence
new_line
to 
text
to 
new_line
base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
```
base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
```
code_fence
new_line
choose dataset from huge amounts of dataset that are possible to use from hf.co/datasets and tweak additional params like batch_size, number of epochs, how often do we want to save our model and many more (which I wont focus on rn). 
text
choose dataset from huge amounts of dataset that are possible to use from hf.co/datasets and tweak additional params like batch_size, number of epochs, how often do we want to save our model and many more (which I wont focus on rn). 
new_line
Then, 
text
Then, 
new_line
accelerate launch -m axolotl.cli.train examples/llama-2/qlora.yml
```
accelerate launch -m axolotl.cli.train examples/llama-2/qlora.yml
```
code_fence
new_line
Will allow to start the finetuning process on structure defined strictly by you.  After finetuning, model will be saved in path provided in config, and you can check out if it performs better than  the base one. Or even you can put it on llm Leaderboard to check if we do not have new SOTA :)
text
Will allow to start the finetuning process on structure defined strictly by you.  After finetuning, model will be saved in path provided in config, and you can check out if it performs better than  the base one. Or even you can put it on llm Leaderboard to check if we do not have new SOTA :)
new_line
Have fun and have a great day <3
text
Have fun and have a great day <3
new_line
GPU Poor POV: Dont be Afraid :D

Sometimes we dont want to do something because of low self esteem,
I ofter hear 'its to hard for me','i am not an expert','i do not know how to do it', etc. These  words are  never the truth,  we should not be afraid and try to build something because there is no additive value without a failure. 

Same things comes in LLMs, there is a lot of fancy words happening, but whats is more important is that there are also  people who are constantly building so other can build.  Diving into finetuning LLMs is incredibly simple if we assume using axolotl library and pretrains stored on huggingface. 

All we need is an idea, our GPU Poor desktop or colab notebooks and these steps:
```
git clone https://github.com/OpenAccess-AI-Collective/axolotl
cd axolotl

pip3 install packaging
pip3 install -e '.[flash-attn,deepspeed]'
```
After installation process we can go to examples, and modify configs to our own needs. 
Lets jump into 
```
axolotl\examples\llama-2\qlora.yml 
```
and change 
```
base_model: NousResearch/Llama-2-7b-hf
```
to 
```
base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
```
choose dataset from huge amounts of dataset that are possible to use from hf.co/datasets and tweak additional params like batch_size, number of epochs, how often do we want to save our model and many more (which I wont focus on rn). 
Then, 
```
accelerate launch -m axolotl.cli.train examples/llama-2/qlora.yml
```
Will allow to start the finetuning process on structure defined strictly by you.  After finetuning, model will be saved in path provided in config, and you can check out if it performs better than  the base one. Or even you can put it on llm Leaderboard to check if we do not have new SOTA :)
Have fun and have a great day <3

👍
KnutJaegersberg Csplk miesnerjacob victor alazro becstar samusenps ameerazam08 NeuralNovel pro7357 s3nh Solshine merve aardoi joujiboi danielus Ji-Ha
🤗
xpgx1 samusenps ameerazam08 NeuralNovel Solshine clem s3nh joujiboi
❤️
NeuralNovel afrideva clem joujiboi
645cfe4603fc86c46b3e46d1
https://cdn-avatars.huggingface.co/v1/production/uploads/645cfe4603fc86c46b3e46d1/-72dah0aoELhfwYwNJ6Ig.jpeg
Lee Jackson
NeuralNovel
user
63eed5ff6c2c7c702bf89782
/avatars/50070b95473ad4819a1d2d7a2a7e4b7e.svg
afrideva
afrideva
user
654527ce2a13610acc25d921
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/eXiGSHeBcKbFAQIhjiQ8r.jpeg
Caleb DeLeeuw
Solshine
user
61caeda441f9432649f03ab6
https://cdn-avatars.huggingface.co/v1/production/uploads/61caeda441f9432649f03ab6/IazJBCi7Cr34DgZXZeI4k.jpeg
s3nh
s3nh
user