Reorganize Safetensors to Layer-Sequential Sharding

#2
AI21 org
No description provided.
asafgardin changed pull request title from Sorted model weights to PR: Reorganize Safetensors to Layer-Sequential Sharding
asafgardin changed pull request title from PR: Reorganize Safetensors to Layer-Sequential Sharding to Reorganize Safetensors to Layer-Sequential Sharding
AI21 org

Sequential Ordering: Tensors are now grouped by layer (0 to N) instead of being scattered randomly across files.

asafgardin changed pull request status to merged

Sign up or log in to comment