20
May
April 2024, what a month! My birthday, a new book release, spring is finally here, and four major open LLM releases: Mixtral, Meta AI's Llama 3, Microsoft's Phi-3, and Apple's OpenELM.This article reviews and discusses all four major transformer-based LLM model releases that have been happening in the last few weeks, followed by new research on reinforcement learning with human feedback methods for instruction finetuning using PPO and DPO algorithms.1. How Good are Mixtral, Llama 3, and Phi-3?2. OpenELM: An Efficient Language Model Family with Open-source Training and Inference Framework3. Is DPO Superior to PPO for LLM Alignment? A Comprehensive…