Module 3: Training and Generation¶
Figure M3.1: Training and Generation in the big picture.
With the engine built, it is time to turn it on. For a business use case, this is where we train the house-style assistant on your company's specific archive and then deploy it to generate value. We will feed it Shakespeare, teach it to write, and explore how to control its creativity.
In this module you will:
- Prepare a dataset and data loader for training
- Write the training loop that improves the model
- Save your progress using checkpoints
- Learn how greedy and sampling generation work
- Use temperature and top-k to control text creativity
- Put it all together into a complete pipeline