Qwen Chat 1.8B for RK3588
This is a conversion from https://huggingface.co/Qwen/Qwen-1_8B/ to the RKLLM format for Rockchip devices. This runs on the NPU from the RK3588
Latest update: April 2024. Converted with RKLLM runtime 1.0.0.
Main repo
See this for my full collection of converted LLMs for the RK3588's NPU:
https://huggingface.co/Pelochus/ezrkllm-collection
License
Same as the original LLM https://huggingface.co/Qwen/Qwen-1_8B/
- Downloads last month
- 10
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support