Stanford CS224R Deep Reinforcement Learning | Spring 2025 | Lecture 10: RL for LLM Reasoning // TRAIN BRAIN

Stanford CS224R Deep Reinforcement Learning | Spring 2025 | Lecture 10: RL for LLM Reasoning

View course details: https://online.stanford.edu/courses/xcs224r-deep-reinforcement-learning
May 2, 2025
This lecture covers reinforcement learning for LLM reasoning.
To learn more about enrolling in the graduate course, visit: https://online.stanford.edu/courses/cs224r-deep-reinforcement-learning
To follow along with the course schedule and syllabus, visit:
https://cs224r.stanford.edu/
Aviral Kumar
Professor at Carnegie Mellon University

Stanford Online

You can gain access to a world of education through Stanford Online, the Stanford School of Engineering’s portal for academic and professional education offered by schools and units throughout Stanford University. https://online.stanford.edu/ Our robust ...

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 13: Data (Sources, Datasets)

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 12: Evaluation

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 11: Scaling Laws

Stanford CME296 Diffusion & Large Vision Models | Spring 2026 | Lecture 6 - Model Training

Stanford CS153 Frontier Systems | Jensen Huang from NVIDIA on the Compute Behind Intelligence

Stanford CS153 Frontier Systems | Scott Nolan from General Matter on Energy Bottlenecks

Stanford Robotics Seminar ENGR319 | Spring 2026 | Unlocking Autonomous Medical Robotics

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 10: Inference

Stanford CME296 Diffusion & Large Vision Models | Spring 2026 | Lecture 5 - Architectures

Stanford CS25: Transformers United V6 I From Next-Token Prediction to Next-Generation Intelligence

Stanford CS25: Transformers United V6 I The Ultra-Scale Talk: Scaling Training to Thousands of GPUs

Stanford CS153 Frontier Systems | Ben Horowitz from a16z on Venture Capital Systems, Network Effects

Stanford CS153 Frontier Systems | Nikhyl Singhal from Skip on Product Management in the AI Era

Stanford CS153 Frontier Systems | Amit Jain from Luma AI on Unified Intelligence Systems

Stanford Online AI Programs Top Questions: When and How to Enroll in Online AI Courses

Stanford Online AI Programs Top Questions: Enrolling in Online Courses vs Self Study

Stanford Online AI Programs Top Questions: What's the Learning Experience Like?

Stanford Online AI Programs Top Questions: Ready to Start? Preparing for Success

Stanford Online AI Programs Top Questions: Choosing Your AI Program and Getting Started

Stanford Online AI Programs Top Questions: Graduate vs Professional - Which Is Right for You?

Stanford CS153 Frontier Systems | Andreas Blattmann from Black Forest Labs on Visual Intelligence

Stanford CS153 Frontier Systems | Mati Staniszewski from ElevenLabs on The Future of Voice Systems

Stanford's Code in Place Info Session with Mehran Sahami

Stanford CS153 Frontier Systems | Anjney Midha from AMP PBC on Frontier Systems

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 9: Scaling Laws

Stanford CS547 HCI Seminar | Spring 2026 | Observing the User Experience in 2026

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 8: Parallelism

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 7: Parallelism

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 6: Kernels, Triton, XLA

Stanford CME296 Diffusion & Large Vision Models | Spring 2026 | Lecture 4 - Latent Space & Guidance

Stanford CS25: Transformers United V6 I On the Tradeoffs of State Space Models and Transformers

Stanford CS25: Transformers United V6 I From Representation Learning to World Modeling

Stanford CS25: Transformers United V6 I Overview of Transformers

Stanford Robotics Seminar ENGR319 | Spring 2026 | Mechanical Intelligence in Locomotion

Stanford Robotics Seminar ENGR319 | Spring 2026 | Robot Learning from Human Experience

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 5: GPUs, TPUs

Stanford Course - Web Security

Stanford CME296 Diffusion & Large Vision Models | Spring 2026 | Lecture 3 - Flow matching

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 3: Architectures

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 2: PyTorch (einops)

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 1: Overview, Tokenization

Stanford CME296 Diffusion & Large Vision Models | Spring 2026 | Lecture 2 - Score matching

Stanford CME296 Diffusion & Large Vision Models | Spring 2026 | Lecture 1 - Diffusion

Stanford Robotics Seminar ENGR319 | Winter 2026 | Gen Control, Action Chunking, Moravec’s Paradox

Stanford CS547 HCI Seminar | Winter 2026 | Computational Ecosystems

Stanford AA228V I Validation of Safety Critical Systems I Explainability

Manage the competing demands of leadership

Course Overview: Systems Leadership

Stanford CS547 HCI Seminar | Winter 2026 | Visual and Algorithmic Interpretation for Responsible AI

Stanford Robotics Seminar ENGR319 | Winter 2026 | Robot Motion Learning w/Physics-Based PDE Priors

Stanford CS193p: iOS Development with SwiftUI | 2025 | L16: Shapes, Gestures, Persistence

Stanford CS193p: iOS Development with SwiftUI | 2025 | L15: Multithreading

Stanford CS193p: iOS Development with SwiftUI | 2025 | L14: SwiftData Demonstration

Stanford CS193p: iOS Development with SwiftUI | 2025 | L13: SwiftData

Climate Innovation: Digital Technology for Sustainable Agriculture and Infrastructure Development

Stanford Webinar - AI and Climate: From Grids to Data Centers — AI Strategy & Innovation

Stanford Robotics Seminar ENGR319 | Autumn 2025 | The Dynamics of Fluid Physical Interaction

Stanford CS547 HCI Seminar | Autumn 2025 | Tracing and Shaping Paths in Design Space

Stanford CS230 | Autumn 2025 | Lecture 9: Career Advice in AI

Stanford CS230 | Autumn 2025 | Lecture 10: What’s Going On Inside My Model?

Stanford Robotics Seminar ENGR319 | Autumn 2025 | Next Generation Dexterous Manipulation

Stanford CME295 Transformers & LLMs | Autumn 2025 | Lecture 9 - Recap & Current Trends

Stanford CS224R Deep Reinforcement Learning | Spring 2025 | Lecture 1: Class Intro

Stanford CS224R Deep Reinforcement Learning | Spring 2025 | Lecture 2: Imitation Learning

Stanford CS224R Deep Reinforcement Learning | Spring 2025 | Lecture 3: Policy Gradients

Stanford CS224R Deep Reinforcement Learning | Spring 2025 | Lecture 4: Actor-Critic Methods

Stanford CS224R Deep Reinforcement Learning | Spring 2025 | Lecture 5: Off-Policy Actor Critic

Stanford CS224R Deep Reinforcement Learning | Spring 2025 | Lecture 6: Q-Learning

Stanford CS224R Deep Reinforcement Learning | Spring 2025 | Lecture 7: Offline RL

Stanford CS224R Deep Reinforcement Learning | Spring 2025 | Lecture 8: Reward Learning

Stanford CS224R Deep Reinforcement Learning | Spring 2025 | Lecture 9: RL for LLMs

Stanford CS224R Deep Reinforcement Learning | Spring 2025 | Lecture 10: RL for LLM Reasoning

Stanford CS224R Deep Reinforcement Learning | Spring 2025 | Lecture 11: Model-Based RL

Stanford CS224R Deep Reinforcement Learning | Spring 2025 | Lecture 12: Multi-Task RL

Stanford CS224R Deep Reinforcement Learning | Spring 2025 | Lecture 13: Meta RL

Stanford CS224R Deep Reinforcement Learning | Spring 2025 | Lecture 14: Exploration

Stanford CS224R Deep Reinforcement Learning | Spring 2025 | Lecture 15: Hierarchical RL and IL

Stanford CS193p: iOS Development with SwiftUI | 2025 | L12: Even More Complex UIs

Stanford CS193p: iOS Development with SwiftUI | 2025 | L11: iPad and Mac

Stanford CS193p: iOS Development with SwiftUI | 2025 | L10: Building Complex UIs