People are using various powerful setups to train LLMs locally. For instance, one user reported using 3 Nvidia RTX 4090 GPUs and a Tesla A100. These rigs are often used for tasks like fine-tuning models, visualizing attention, and evaluating embeddings. The process can generate significant heat, especially in setups with multiple high-performance GPUs.