9
Lesson 9 of 20 · Smart Helpers
The cost of AI
Running LLMs requires expensive GPU clusters. Training GPT-4 cost over $100 million. Companies balance capability with computational cost.
- AI training and inference require expensive hardware.
- Cost constrains model size and capabilities.
Think about it
What is the difference between API and user-facing AI?