So far, running LLMs has required a large amount of computing resources, mainly GPUs. Running locally, a simple prompt with a typical LLM takes on an average Mac ...
Lots of simple and Pythonic PySide demos, this project is released under the permissive 3-clause BSD license.