6.2 How Generative AI Works
It learns patterns from massive datasets, then builds outputs step by step - one word or one denoising step at a time.
Chapter 6: Generative AI
Different kinds of generative AI use different tricks. Text models predict the next word-piece (token) over and over until a full answer is built.
Image models like diffusion models start with pure random noise and gradually remove noise, step by step, guided by your prompt, until an image appears. It's like a sculpture slowly emerging from a block of static.
All of them share the same base idea: learn the patterns of real data so well that you can produce new examples that look like they belong.
Key takeaways
Text models predict the next token, again and again
Image diffusion models remove noise step by step
All learn patterns from huge datasets