Currently, NixOS offers packages for llama-cpp and the AI assistant TabbyML, which is built on llama-cpp. Arch Linux provides the ollama package officially and has additional related packages available in the AUR. These AI assistants are readily bundled in their respective distribution repositories, making them easy to install and use.