
The One-Line Slowdown: Why AI Models Get Slower
Learn more about model collapse here → https://ibm.biz/~bs0HZQOH7
Your AI model runs, but the output is wrong. Antoni Viros i Martin explains how hidden synchronization and graph breaks can quietly slow AI training and reduce compiler optimizations. Learn a practical debugging mindset for improving AI model performance in PyTorch and compiled workloads.
00:00 - The Hidden Cost of Reading a Single Tensor Value
00:13 - How Torch.compile Optimizes Your Model
00:35 - Why Accelerators Work Ahead of Python
00:48 - The .item() Problem: Python Scalar Reads
01:12 - How Graph Breaks Fragment Optimized Regions
01:56 - Synchronization: When Python Forces the Chip to Wait
02:55 - The Real Performance Penalty: Empty Accelerator Queues
03:03 - How to Avoid These Slowdowns in Compiled Models
Continue your education in the course Compilation for Dataflow on Coursera here → https://ibm.biz/~yeC2veTHU
AI news moves fast. Sign up for a monthly newsletter for AI updates from IBM → https://ibm.biz/~6cdGktmYf
AI was used in the creation of the transcript and metadata for this video.
#aimodels #aitraining #pytorch #ai
---------------------------------------------------------------------------------------------------------
Find us on YouTube:
? IBM Technology: https://www.youtube.com/@IBMTechnology
? IBM: https://www.youtube.com/@IBM
? IBM Developer: https://youtube.com/@IBMDeveloperAdvocates
Your AI model runs, but the output is wrong. Antoni Viros i Martin explains how hidden synchronization and graph breaks can quietly slow AI training and reduce compiler optimizations. Learn a practical debugging mindset for improving AI model performance in PyTorch and compiled workloads.
00:00 - The Hidden Cost of Reading a Single Tensor Value
00:13 - How Torch.compile Optimizes Your Model
00:35 - Why Accelerators Work Ahead of Python
00:48 - The .item() Problem: Python Scalar Reads
01:12 - How Graph Breaks Fragment Optimized Regions
01:56 - Synchronization: When Python Forces the Chip to Wait
02:55 - The Real Performance Penalty: Empty Accelerator Queues
03:03 - How to Avoid These Slowdowns in Compiled Models
Continue your education in the course Compilation for Dataflow on Coursera here → https://ibm.biz/~yeC2veTHU
AI news moves fast. Sign up for a monthly newsletter for AI updates from IBM → https://ibm.biz/~6cdGktmYf
AI was used in the creation of the transcript and metadata for this video.
#aimodels #aitraining #pytorch #ai
---------------------------------------------------------------------------------------------------------
Find us on YouTube:
? IBM Technology: https://www.youtube.com/@IBMTechnology
? IBM: https://www.youtube.com/@IBM
? IBM Developer: https://youtube.com/@IBMDeveloperAdvocates
IBM Technology
Whether it’s AI, automation, cybersecurity, data science, DevOps, quantum computing or anything in between, we provide educational content on the biggest topics in tech. Subscribe to build your skillset, learn about new trends, and gain insights from IBM ...