
Retrieval as Inference: Building a Production-Scale Torch-Native Retrieval Engine with Dhritiman Das
Dhritiman Das, Staff Software Engineer - Machine Learning Infrastructure at LinkedIn, will present a torch-native retrieval engine that uses PyTorch as the primary runtime for retrieval, filtering, and ranking at PyTorch Conference North America 2026.
The system combines a GPU-resident torch tensor index, tensor-based retrieval operations, custom CUDA kernels for attribute filtering, and TorchScript model execution within a unified serving architecture orchestrated through a Rust and tch-rs backend.
Dhritiman will also share how the approach scales to critical use cases like feed and search at LinkedIn.
Join us in San Jose on October 20-21: https://hubs.la/Q04v4SL60
View the poster sessions: https://events.linuxfoundation.org/pytorch-conference-north-america/program/schedule-posters/
#PyTorchCon
The system combines a GPU-resident torch tensor index, tensor-based retrieval operations, custom CUDA kernels for attribute filtering, and TorchScript model execution within a unified serving architecture orchestrated through a Rust and tch-rs backend.
Dhritiman will also share how the approach scales to critical use cases like feed and search at LinkedIn.
Join us in San Jose on October 20-21: https://hubs.la/Q04v4SL60
View the poster sessions: https://events.linuxfoundation.org/pytorch-conference-north-america/program/schedule-posters/
#PyTorchCon
PyTorch
Welcome to the official PyTorch YouTube Channel. Learn about the latest PyTorch tutorials, new, and more.
PyTorch is an open source machine learning framework that is used by both researchers and developers to build, train, and deploy ML systems that so...
torch.compile and Diffusers: A Hands-On Guide to Peak Performance - Sayak Paul, Hugging Face
PyTorch
torch compile and Diffusers - A Hands On Guide to Peak Performance - PyTorch Compiler Series
PyTorch
verl: An Open Source Large Scale LLM RL Framework for Agentic Tasks - Yuxuan Tong, Bytedance
PyTorch
Lightning Talk: Sparsifying Vision Transformers with Minimal Accuracy Loss - Jesse Cai, Meta
PyTorch