Running Code Llama 70B effectively typically requires GPUs with substantial video memory. Using a server with only 128 GB of RAM would likely not be sufficient without dedicated GPUs, especially for decent performance. For best results, consider a setup with GPUs like RTX 4090s or Teslas, which support multi-GPU configurations and faster token generation.