What local model is Mac mini suitable for running?
by Poster
Dec 11, 2024
0
I ran an llama2, the speed is so slow
Curl-X POST http://localhost: 11434/api/generate-d '{
"model": "llama2",
"prompt": "Why is the sky blue?
}'
With the official instructions, it took more than a minute to finish answering...
What local model does everyone run on their mac mini?
Replies
- No replies yet.