It is commonly assumed that Large Language Models (LLMs) will keep improving because current scaling laws show clear power-law relationships indicating performance gains with increased data and parameters. No limits have been found yet, and continuous innovations in data collection, compute power, and algorithms suggest ongoing advancements. However, historical engineering trends advise caution against indefinite extrapolation.