Understand the limitations of LLMs, including hallucinations, bias, context window constraints, and the high cost of compute and data.