PPO

Area What the evidence says Planning use Pipeline shape Three stages: pretraining, instruction fine-tuning, then preference alignment Start from an…