Local AI App Runs an 80B Model on an 8GB Mac
A new app shared on Hacker News says it can run an AI model with about 80 billion settings on a Mac with just 8GB of memory. If it works as described, big AI models could run on an ordinary laptop, which is a useful step for everyday users to try AI themselves.
Quick glossaryyanahchat.com, local AI, 80B model
- yanahchat.com
- The website of the app in this story, which the post says runs a large AI model on a Mac.
- local AI
- AI that runs directly on your own computer, rather than sending your questions over the internet to distant servers.
- 80B model
- An AI model with about 80 billion internal settings, which lets it handle complex questions and tasks.
Burning Potato score: 66%