So far, running LLMs has required a large amount of computing resources, mainly GPUs. Running locally, a simple prompt with a typical LLM takes on an average Mac ...

$ python3 -m venv venv $ source venv/bin/activate $ pip3 install -e . $ pip3 install -r requirements.txt # Running tests $ pytest # Formatting and linting $ pre-commit run --all-files ...