ggml-org
/

Laya-GGUF

Text Classification

feature-extraction

Model card Files Files and versions

Laya

Run with https://llama.app

llama serve -hf ggml-org/Laya-GGUF

This is a decision model, to be used via /v1/systemone API. See https://github.com/ggml-org/llama.cpp/pull/29818

Source models

https://huggingface.co/convaiinnovations/laya

This model is automatically converted using https://github.com/ggml-org/convert

Downloads last month: 5,056

GGUF

Model size

0.4B params

Architecture

modern-bert

Hardware compatibility

Log In to add your hardware

8-bit

16-bit

Model tree for ggml-org/Laya-GGUF

Base model

convaiinnovations/laya

Quantized

(59)

this model

Space using ggml-org/Laya-GGUF 1

Collection including ggml-org/Laya-GGUF

Decision models

GGUF decision models for the /v1/systemone API in llama.cpp • 6 items • Updated 2 days ago • 14

Article mentioning ggml-org/Laya-GGUF

New in llama.cpp: Decision Models