Jetson Thor LLM Performance Gains - Up to 3.3x Faster! // TRAIN BRAIN

Jetson Thor LLM Performance Gains - Up to 3.3x Faster!

NVIDIA has released a new update to the vLLM inference engine with performance gains for generative AI. This is a software update, that is better optimized (FlashInfer support, Xformers integration, and other optimizations) for the Jetson Thor.
---
⭐ Please support my channel on Patreon!
Get early access to videos, members-only content, behind-the-scenes updates, and join the Gary Explains Discord! Join here ? https://www.patreon.com/GaryExplains ?
Twitter: https://twitter.com/garyexplains
Instagram: https://www.instagram.com/garyexplains/
#garyexplains

Gary Explains

Gary tries his best to explain how stuff works....

I Bought the CHEAPEST Wi-Fi Extender on Earth… Total Scam or Hidden Gem?

You Won't Believe What a 8GB PC Can STILL Do in 2026!

Winboat: Run Any Windows App on Linux!

Unlock the Power of LLMs on Your Raspberry Pi & AI HAT+ 2 with My New Open Source Tool!

Raspberry Pi AI HAT+ 2: Setup with Pi 5 & LLM Performance

Porting Parts of The Unix v4 Source Code to Windows!

End of Year Recap: My Most Popular Videos of 2025

Set Up a Stunning Raspberry Pi Dashboard This Weekend!

NVIDIA Just Dropped a FREE AI Model That You Can Run on Your PC - Nemotron 3 Nano

Create Polished Guides in Minutes with Tango - Smooth Workflow Moves!

TerraMaster F4-425 Plus - A Hybrid NAS That Doubles as a Home Lab Server

Copyparty: The File Server I Wish I Discovered Years Ago

ChatGPT 5.1 vs Gemini 3 Pro: Can Google Beat OpenAI at its Own Game?

Raspberry Pi Imager 2.0: Set Up Your Raspberry Pi in Minutes

Microsoft has Designed its Own 132 Core Processor: Azure Cobalt 200

Apple A19 Pro vs Snapdragon 8 Elite G5 vs Dimensity 9500: Peak Performance and Sustained Performance

3 Linux Distros You Haven’t Heard of But You Should Try

How to Enroll in Windows 10 ESU - Get Another Year of FREE Updates for Windows 10

How to Start windows 10 in Safe Mode - The Easy Way!

How to Start windows 10 in Safe Mode - Using msconfig

How to Start Windows 11 in Safe Mode - EASIEST METHOD

How to Start Windows 11 in Safe Mode - Using msconfig Command

How to Start Windows 11 in Safe Mode - Using bcdedit Command

The Raspberry Pi Pico Now Has Official Rust Tools - Here’s How it Works

LiberNovo Omni is a Total Game-Changer for Programmers, Gamers, and Content Creators

Arduino Uno Q vs Raspberry Pi - Which One Should You Buy?

How to Program the Arduino Uno Q with Python and C++

Arduino Uno Q: Linux Desktop Tour

Arduino Uno Q Unboxing #garyexplains #qualcomm #arduino

Arduino Uno Q Unboxing

OpenAI's New ChatGPT Atlas Web Browser: Why I’m Totally Confused!

Apple M5 Deep Dive - Apple Adds GPU Compute and PCIe 5.0 NVMe

How Zorin 18 Could Replace Windows 10 on Your PC

Jetson Thor LLM Performance Gains - Up to 3.3x Faster!

Linux Mint Walkthrough: Desktop Tour for Beginners!

The Simplest Way to Try Linux: Hyper-V Setup + Desktop Walkthrough

MusicGPT: Turning a One-Line Prompt Into a Studio Level Song

New Version of Raspberry Pi OS Based on Debian 13 (Trixie)

Snapdragon X2 Elite Extreme - 18 Oryon CPU Cores with a Geekbench Single Core Score of over 4000!

Raspberry Pi 500+ Review - Mechanical Keyboard, 16GB RAM, 256 GB SSD

The Snapdragon 8 Elite Gen 5 Benchmarks Are INSANE - Geekbench Single Core & Multi Core Scores

Snapdragon 8 Elite Gen 5 Benchmarks Are INSANE #garyexplains #snapdragon #qualcomm

The Snapdragon 8 Elite Gen 5 is Here with 3rd Gen Oryon CPU Cores Clocked at 4.6GHz

MediaTek Dimensity 9500 - All Big Core CPU design with Arm C1-Ultra at 4.21GHz

Void Pointer in C Demystified

Microsoft Notepad Now Supports Markdown: Learn How to Use It!

How to Fullscreen on Windows

Debian 13: The Release That Will Shape Linux for Years

How to Unzip a File on Windows

How to Screenshot on Windows with the Game Bar

5 Things About ChatGPT 5 That Are Brilliant – And 3 That Aren't

Run OpenAI's o4-mini Variant on Your PC - New Open Models for Everyone from the Makers of ChatGPT

RISC-V CH32 vs ARM Cortex: Who Wins in Speed & Power?

How to screenshot on Windows with the Snipping Tool

Arduino Nano R4: Everything You Need to Know

The Secret Behind Android's New 10% Speed Increase: 16KB Page Size Explained!

How to Screenshot on Windows using Print Screen Key

Rockchip Accidentally Reveals New Arm CPU - New CPUs and GPUs Incoming!

Bring Back the '80s: Create Demoscene Magic on Your PC (Lua Code Included)

Samsung Exynos 2500: Described, Compared, and Benchmarked

How to take a screenshot on Windows using Win + Print Screen

Arm's New CPU to Supercharge AI on Android with Scalable Matrix Extension

Intel vs AMD: Decades of Rivalry and Drama

How to take a screenshot on Windows with CTRL + Print Screen

What Comes After LLMs? John Carmack Bets on AI Quick Learning Techniques

DHCP Deep Dive: Packet-Level Analysis and Protocol Explainer

Ditching Windows and Switching to Linux: Attitudes That Make or Break the Move

Microsoft's Phi4-Reasoning Model BLEW My Mind – It Runs on Anything From a Raspberry Pi Upwards!

What Can a 500MB LLM Actually Do? You'll Be Surprised!

How to Control Your Home PC From Anywhere with RustDesk

Is Managing Team Passwords Giving You Nightmares? Passbolt 5 Could Be The Answer

Vanilla OS: The Immutable Linux Distro That Won’t Let You Break It!

OpenAI is Messing with Our Minds: 4.1 Beats 4.5

Immutable Linux: Because Who Likes Accidental Breakage?

Boot Like a Boss: Ventoy Explained in 5 Minutes

Meta's Llama 4 Tested – Revolutionary or Redundant?

Zorin OS: The Linux That Feels Like Windows (But Better!)

Resistance to Change - In a World Where AI is Inevitable

Demystifying Text Embeddings: How Language Becomes Data

I Challenged Gemini 2.5 Pro... and Regret Everything