| license: apache-2.0 | |
| inference: false | |
| base_model: llmware/slim-summary-phi-3 | |
| base_model_relation: quantized | |
| tags: [green, p3, llmware-fx, onnx] | |
| # slim-summary-phi-3-onnx | |
| **slim-summary-phi-3-onnx** is a specialized function calling model that summarizes a given text and generates as output a Python list of summary points. | |
| This is an ONNX int4 quantized version of [slim-summary-phi-3](https://www.huggingface.co/llmware/slim-summary-phi-3), providing a very fast, very small inference implementation, optimized for AI PCs using Intel GPU, CPU and NPU. | |
| ### Model Description | |
| - **Developed by:** llmware | |
| - **Model type:** phi-3 | |
| - **Parameters:** 3.8 billion | |
| - **Model Parent:** llmware/slim-summary-phi-3 | |
| - **Language(s) (NLP):** English | |
| - **License:** Apache 2.0 | |
| - **Uses:** Summary bulletpoints extracted from complex business documents | |
| - **RAG Benchmark Accuracy Score:** NA | |
| - **Quantization:** int4 | |
| ## Model Card Contact | |
| [llmware on github](https://www.github.com/llmware-ai/llmware) | |
| [llmware on hf](https://www.huggingface.co/llmware) | |
| [llmware website](https://www.llmware.ai) | |