From Academic Research to a Frontier LLM: A Case Study in DPO [video]