Inference Providers
Active filters: rockchip
Prince-1/TinyLlama-1.1B-Chat-v1.0-RKLLM
Updated • 5
• 1
Image-Text-to-Text
• Updated • 4
jamescallander/deepseek-llm-7b-chat_w8a8_g128_rk3588.rkllm
Text Generation
• Updated • 32
jamescallander/txgemma-9b-chat_w8a8_g128_rk3588.rkllm
Text Generation
• Updated • 5
jamescallander/NextCoder-7B_w8a8_g128_rk3588.rkllm
Text Generation
• Updated • 40
• 1
jamescallander/Qwen2.5-Math-1.5B-Instruct_w8a8_g128_rk3588.rkllm
Text Generation
• Updated • 9
jamescallander/Qwen2.5-Coder-3B-Instruct_w8a8_g128_rk3588.rkllm
Text Generation
• Updated • 366
• 2
jamescallander/Llama-3.1-8B-Instruct_w8a8_g128_rk3588.rkllm
Text Generation
• Updated • 57
jamescallander/MiniCPM4-0.5B_w8a8_g128_rk3588.rkllm
Text Generation
• Updated • 27
jamescallander/TinyLlama-1.1B-Chat-v1.0_w8a8_g128_rk3588.rkllm
Text Generation
• Updated • 29
• 1
jamescallander/Qwen2.5-Math-7B-Instruct_w8a8_g128_rk3588.rkllm
Text Generation
• Updated • 51
jamescallander/deepseek-coder-1.3b-instruct_w8a8_g128_rk3588.rkllm
Text Generation
• Updated • 15
jamescallander/MiniCPM3-4B_w8a8_g128_rk3588.rkllm
Text Generation
• Updated • 20
jamescallander/Llama-3.2-3B-Instruct_w8a8_g128_rk3588.rkllm
Text Generation
• Updated • 62
cluangar/typhoon2-qwen2.5-7B-rk3588
Text Generation
• Updated • 1
jamescallander/DeepSeek-R1-Distill-Qwen-14B_w8a8_g128_rk3588.rkllm
Text Generation
• Updated • 29
jamescallander/deepseek-coder-6.7b-instruct_w8a8_g128_rk3588.rkllm
Text Generation
• Updated • 8
jamescallander/CodeLlama-7b-Instruct-hf_w8a8_g128_rk3588.rkllm
Text Generation
• Updated • 31
jamescallander/DeepSeek-R1-Distill-Qwen-1.5B_w8a8_g128_rk3588.rkllm
Text Generation
• Updated • 35
jamescallander/DeepSeek-R1-Distill-Llama-8B_w8a8_g128_rk3588.rkllm
Text Generation
• Updated • 11
jamescallander/gemma-2-2b-it_w8a8_g128_rk3588.rkllm
Text Generation
• Updated • 24
jamescallander/gemma-3-4b-it_w8a8_g128_rk3588.rkllm
Text Generation
• Updated • 572
jamescallander/gemma-3-1b-it_w8a8_g128_rk3588.rkllm
Text Generation
• Updated • 39
jamescallander/gemma-3-270m-it_w8a8_g128_rk3588.rkllm
Text Generation
• Updated • 17
jamescallander/qwen2-5_convos__SCP_org_chemistry_w8a8_g128_rk3588.rkllm
Text Generation
• Updated • 2
flylcw/Qwen3-4B-Instruct-2507_w8a8_g128_1.2.2_rkllm
Text Generation
• Updated • 24
• 2
Prince-1/SmolVLM-Instruct-RKllm
Image-Text-to-Text
• Updated • 3
• 1
kautism/DeepSeek-R1-Distill-Qwen-1.5B_w8a8_g128_rk3588.rkllm
Text Generation
• Updated • 8
rk-transformers/distilbert-base-uncased-finetuned-sst-2-english
rk-transformers/all-MiniLM-L6-v2
Sentence Similarity
• Updated • 23