Lizonghang/prima.cpp prima.cpp: Speeding up 70B-scale LLM inference on low-resource everyday home clusters **Language:**C++ Total stars: 101 Stars trend: 15 Apr 2025 2am ██ +16 3am ██▋ +21 4am █ +8 5am ▌ +4 6am █ +8 7am ▌ +4 8am ▍ +3 9am ▍ +3 10am ▏ +1 11am ▋ +5 12pm ▋ +5 #cplusplus #distributedai, #llamacpp, #llminference, #ondevicellms
15 Apr 2025 2am ██ +16 3am ██▋ +21 4am █ +8 5am ▌ +4 6am █ +8 7am ▌ +4 8am ▍ +3 9am ▍ +3 10am ▏ +1 11am ▋ +5 12pm ▋ +5
prima.cpp: Speeding up 70B-scale LLM inference on low-resource everyday home clusters
**Language:**C++
**Total stars:** 101
**Stars trend:**
`15 Apr 2025
2am ██ +16
3am ██▋ +21
4am █ +8
5am ▌ +4
6am █ +8
7am ▌ +4
8am ▍ +3
9am ▍ +3
10am ▏ +1
11am ▋ +5
12pm ▋ +5`
#cplusplus
#distributedai, #llamacpp, #llminference, #ondevicellms](https://images.deso.org/8d4f324bd2076346969e8d08e6b4047a3e3e292876f119f2f27f50a1a913aae1.webp)
Lizonghang/prima.cpp prima.cpp: Speeding up 70B-scale LLM inference on low-resource everyday home clusters **Language:**C++ Total stars: 101 Stars trend:
15 Apr 2025 2am ██ +16 3am ██▋ +21 4am █ +8 5am ▌ +4 6am █ +8 7am ▌ +4 8am ▍ +3 9am ▍ +3 10am ▏ +1 11am ▋ +5 12pm ▋ +5#cplusplus #distributedai, #llamacpp, #llminference, #ondevicellms