Question for Finetuning
#3
by
SFPLM - opened
Honestly not too familiar with finetuning but I wonder what would be the VRAM Requirement to finetune dots.llm.
Would it be possible to with Unsloth via Qlora or Qlora based if you have 96 GB of VRAM and could run it on Q4KXL fully on VRAM with some context? Say you used the "shiny workstation blackwell card" or even a H200?