Raspberry Pi AI HAT+ 2: Setup with Pi 5 & LLM Performance // TRAIN BRAIN

Raspberry Pi AI HAT+ 2: Setup with Pi 5 & LLM Performance

Let's dive into the Raspberry Pi AI Hat+ 2 with 40 TOP. I'll walk you through the initial setup process, then show you how to run a Large Language Model (LLM) on this new board. I'll be using my own project, Pillama, and Open WebUI to demonstrate. Finally, I'll reveal the performance numbers, showcasing the tokens per second generated by the CPU alone versus the AI HAT+ 2 board, so you can see the difference!
---
AI HAT+ 2: https://www.raspberrypi.com/documentation/accessories/ai-hat-plus.html
AI Software: https://www.raspberrypi.com/documentation/computers/ai.html
---
⭐ Please support my channel on Patreon!
Get early access to videos, members-only content, behind-the-scenes updates, and join the Gary Explains Discord! Join here ? https://www.patreon.com/GaryExplains ?
Twitter: https://twitter.com/garyexplains
Instagram: https://www.instagram.com/garyexplains/
#garyexplains

Gary Explains

Gary tries his best to explain how stuff works....

I Bought the CHEAPEST Wi-Fi Extender on Earth… Total Scam or Hidden Gem?

You Won't Believe What a 8GB PC Can STILL Do in 2026!

Winboat: Run Any Windows App on Linux!

Unlock the Power of LLMs on Your Raspberry Pi & AI HAT+ 2 with My New Open Source Tool!

Raspberry Pi AI HAT+ 2: Setup with Pi 5 & LLM Performance

Porting Parts of The Unix v4 Source Code to Windows!

End of Year Recap: My Most Popular Videos of 2025

Set Up a Stunning Raspberry Pi Dashboard This Weekend!

NVIDIA Just Dropped a FREE AI Model That You Can Run on Your PC - Nemotron 3 Nano

Create Polished Guides in Minutes with Tango - Smooth Workflow Moves!

TerraMaster F4-425 Plus - A Hybrid NAS That Doubles as a Home Lab Server

Copyparty: The File Server I Wish I Discovered Years Ago

ChatGPT 5.1 vs Gemini 3 Pro: Can Google Beat OpenAI at its Own Game?

Raspberry Pi Imager 2.0: Set Up Your Raspberry Pi in Minutes

Microsoft has Designed its Own 132 Core Processor: Azure Cobalt 200

Apple A19 Pro vs Snapdragon 8 Elite G5 vs Dimensity 9500: Peak Performance and Sustained Performance

3 Linux Distros You Haven’t Heard of But You Should Try

How to Enroll in Windows 10 ESU - Get Another Year of FREE Updates for Windows 10

How to Start windows 10 in Safe Mode - The Easy Way!

How to Start windows 10 in Safe Mode - Using msconfig

How to Start Windows 11 in Safe Mode - EASIEST METHOD

How to Start Windows 11 in Safe Mode - Using msconfig Command

How to Start Windows 11 in Safe Mode - Using bcdedit Command

The Raspberry Pi Pico Now Has Official Rust Tools - Here’s How it Works

LiberNovo Omni is a Total Game-Changer for Programmers, Gamers, and Content Creators

Arduino Uno Q vs Raspberry Pi - Which One Should You Buy?

How to Program the Arduino Uno Q with Python and C++

Arduino Uno Q: Linux Desktop Tour

Arduino Uno Q Unboxing #garyexplains #qualcomm #arduino

Arduino Uno Q Unboxing

OpenAI's New ChatGPT Atlas Web Browser: Why I’m Totally Confused!

Apple M5 Deep Dive - Apple Adds GPU Compute and PCIe 5.0 NVMe

How Zorin 18 Could Replace Windows 10 on Your PC

Jetson Thor LLM Performance Gains - Up to 3.3x Faster!

Linux Mint Walkthrough: Desktop Tour for Beginners!

The Simplest Way to Try Linux: Hyper-V Setup + Desktop Walkthrough

MusicGPT: Turning a One-Line Prompt Into a Studio Level Song

New Version of Raspberry Pi OS Based on Debian 13 (Trixie)

Snapdragon X2 Elite Extreme - 18 Oryon CPU Cores with a Geekbench Single Core Score of over 4000!

Raspberry Pi 500+ Review - Mechanical Keyboard, 16GB RAM, 256 GB SSD

The Snapdragon 8 Elite Gen 5 Benchmarks Are INSANE - Geekbench Single Core & Multi Core Scores

Snapdragon 8 Elite Gen 5 Benchmarks Are INSANE #garyexplains #snapdragon #qualcomm

The Snapdragon 8 Elite Gen 5 is Here with 3rd Gen Oryon CPU Cores Clocked at 4.6GHz

MediaTek Dimensity 9500 - All Big Core CPU design with Arm C1-Ultra at 4.21GHz

Void Pointer in C Demystified

Microsoft Notepad Now Supports Markdown: Learn How to Use It!

How to Fullscreen on Windows

Debian 13: The Release That Will Shape Linux for Years

How to Unzip a File on Windows

How to Screenshot on Windows with the Game Bar

5 Things About ChatGPT 5 That Are Brilliant – And 3 That Aren't

Run OpenAI's o4-mini Variant on Your PC - New Open Models for Everyone from the Makers of ChatGPT

RISC-V CH32 vs ARM Cortex: Who Wins in Speed & Power?

How to screenshot on Windows with the Snipping Tool

Arduino Nano R4: Everything You Need to Know

The Secret Behind Android's New 10% Speed Increase: 16KB Page Size Explained!

How to Screenshot on Windows using Print Screen Key

Rockchip Accidentally Reveals New Arm CPU - New CPUs and GPUs Incoming!

Bring Back the '80s: Create Demoscene Magic on Your PC (Lua Code Included)

Samsung Exynos 2500: Described, Compared, and Benchmarked

How to take a screenshot on Windows using Win + Print Screen

Arm's New CPU to Supercharge AI on Android with Scalable Matrix Extension

Intel vs AMD: Decades of Rivalry and Drama

How to take a screenshot on Windows with CTRL + Print Screen

What Comes After LLMs? John Carmack Bets on AI Quick Learning Techniques

DHCP Deep Dive: Packet-Level Analysis and Protocol Explainer

Ditching Windows and Switching to Linux: Attitudes That Make or Break the Move

Microsoft's Phi4-Reasoning Model BLEW My Mind – It Runs on Anything From a Raspberry Pi Upwards!

What Can a 500MB LLM Actually Do? You'll Be Surprised!

How to Control Your Home PC From Anywhere with RustDesk

Is Managing Team Passwords Giving You Nightmares? Passbolt 5 Could Be The Answer

Vanilla OS: The Immutable Linux Distro That Won’t Let You Break It!

OpenAI is Messing with Our Minds: 4.1 Beats 4.5

Immutable Linux: Because Who Likes Accidental Breakage?

Boot Like a Boss: Ventoy Explained in 5 Minutes

Meta's Llama 4 Tested – Revolutionary or Redundant?

Zorin OS: The Linux That Feels Like Windows (But Better!)

Resistance to Change - In a World Where AI is Inevitable

Demystifying Text Embeddings: How Language Becomes Data

I Challenged Gemini 2.5 Pro... and Regret Everything