PRIMA.CPP: Speeding Up 70B-Scale LLM Inference on Low-Resource Everyday Home Clusters
Paper
•
2504.08791
•
Published
•
139
cgus
cgus
AI & ML interests
Small general-purpose LLMs for text-translation/summarization/limited scenario generation.
Image-generation, mainly lightweight models such as SD1.5.
Occasionally making exl2/GGUF quants on my personal hardware (up to 14B).
Recent Activity
liked
a model
about 3 hours ago
KittenML/kitten-tts-mini-0.8
updated
a model
22 days ago
cgus/Mistral-Nemo-Instruct-2407-heretic-noslop-exl2
liked
a model
27 days ago
YatharthS/LuxTTS
Organizations
None yet
upvoted
a
paper
10 months ago
upvoted
a
collection
10 months ago
upvoted
an
article
about 1 year ago
Article
Merge Large Language Models with mergekit
•
150