PRIMA.CPP: Speeding Up 70B-Scale LLM Inference on Low-Resource Everyday Home Clusters
Paper • 2504.08791 • Published • 141 •
13
LIKirin
LIKirin
AI & ML interests
Intelligent Computing, Distributed Artificial Intelligence, Federated Intelligence, Large-scale AI Training and Applications.
Recent Activity
commentedon a paper about 15 hours ago
PRIMA.CPP: Speeding Up 70B-Scale LLM Inference on Low-Resource Everyday
Home Clusters commentedon a paper 20 days ago
PRIMA.CPP: Speeding Up 70B-Scale LLM Inference on Low-Resource Everyday
Home Clusters upvoted a paper about 1 month ago
QUACK: Questioning, Understanding, and Auditing Communicated Knowledge in Multimodal Social Deduction AgentsOrganizations
None yet
commented a
paper about 15 hours ago
commented a
paper 20 days ago
upvoted a paper about 1 month ago
commented a
paper 10 months ago
commented a
paper about 1 year ago
authored a
paper about 1 year ago
commented a
paper about 1 year ago
upvoted a paper about 1 year ago
commented 3
papers about 1 year ago
PRIMA.CPP: Speeding Up 70B-Scale LLM Inference on Low-Resource Everyday Home Clusters
Paper • 2504.08791 • Published • 141 •
13
TPI-LLM: Serving 70B-scale LLMs Efficiently on Low-resource Edge Devices
Paper • 2410.00531 • Published • 33 •
8
TPI-LLM: Serving 70B-scale LLMs Efficiently on Low-resource Edge Devices
Paper • 2410.00531 • Published • 33 •
8
commented a
paper over 1 year ago
authored a
paper over 1 year ago
upvoted a paper over 1 year ago
updated a
dataset about 2 years ago