Tidal Auto-scaling for Training and Inference Based on Kubernetes + KEDA - Jun Zheng & Tan Pei Xiang
Tidal Auto-scaling for Training and Inference Based on Kubernetes + KEDA - Jun Zheng & Tan Pei Xiang
YouTube — PyTorch Official
Video
1600 articles
Project Lightning Talk: Atlantis: Terraform Pull Request Automation for Cloud Native Teams - R. Chen
Project Lightning Talk: Atlantis: Terraform Pull Request Automation for Cloud Native Teams - R. Chen
YouTube — PyTorch Official
From Open Source Adoption To Open Source Innovation: China’s Next Chapter - Lu Shouqun
Jonathan Polasky, Samsung Tech, Samsung, Samsung, marker, Korean Samsung Tech, Samsung. CNCF, the learning path is open to many, the learning path, everything is pi-touch, the learning path, the layer of her, the jungle of the sun, her, you burn them. Becomes a call. Native color, come, open to layer,...
YouTube — PyTorch Official
Years of Cilium: Connecting, Securing, and Simplifying the Cloud Nat... - L. Huang, T. Ye & Y. Su
Years of Cilium: Connecting, Securing, and Simplifying the Cloud Nat... - L. Huang, T. Ye & Y. Su
YouTube — PyTorch Official
Optimizing Mixture of Experts LLM inference on ARM CPUs
Hi, I'm Majid from Intel Research India, and I'm excited to be speaking at PyTorch Conference North America this October. I'll be talking about efficient mixture of experts LLM inference on using VLLM and OpenVINO, and how we can efficiently run these models on ARM CPUs. If…
YouTube — PyTorch Official
Evolving Argo Workflows for AI: New Features, Tuning, and Multi-Tenant Isolation - S. Tian & Y. Su
Evolving Argo Workflows for AI: New Features, Tuning, and Multi-Tenant Isolation - S. Tian & Y. Su
YouTube — PyTorch Official
Project Lightning Talk: KubeEdge Everywhere: Latest Project Update With Industrial Cases - H. Zhang
Project Lightning Talk: KubeEdge Everywhere: Latest Project Update With Industrial Cases - H. Zhang
YouTube — PyTorch Official
Self-Healing Rollouts: Automating Production Fixes With Agentic AI - Kevin Dubois & Daniel Oh
All right. Uh, thanks for joining today and um, so my name is Daniel uh, from Redhead and also IBM from Boston. It's a long way. Uh, we got here a couple days ago and then but we still a little bit jet lag. Anyway, so so we're going to talk about little bit about the…
YouTube — PyTorch Official
Integrating RCCL GPU-Initiated Networking into TorchTitan’s MoE Communication
Hi, I'm Rishi from AMD. Within distributed training, communication is one of the primary bottlenecks, and limiting the time spent on communication can massively boost end-to-end performance. We investigate this hypothesis by integrating work from the Rickle team to use…
YouTube — PyTorch Official
Inside the PyTorch Ambassador Model: How Ambassadors Grow PyTorch Adoption & How You Can Become One
Hello everyone, I'm Sadiq Allah. I'm a PyTorch Ambassador and an open source developer at IBM. I'll be at the PyTorch conference 2026 in San Jose and I'm excited about many things. About learning, meeting fellow ambassadors, catching up with friends in the community and…
YouTube — PyTorch Official
What You Cannot Profile, You Cannot Optimize: Learning to Read PyTorch Traces
Hello, my name is Souvik and I work at hugging face. I'm going to be at the PyTorch conference 2026 and I will be talking about how you can get started with using the PyTorch profiler on your models. And how you can extract the maximum efficiency from them. Come join us on…
YouTube — PyTorch Official
Extending TorchInductor with FlyDSL: A New MLIR-Native Backend for High-Performance GEMMs
Здравствуйте, я Лиз Ли из AMD. >> Здравствуйте, я Джек Хуай из AMD. >> Современные рабочие нагрузки ИИ зависят от растущего спектра специализированных ядер GPU, и ни один бэкенд генерации ядер не является оптимальным для всех форм операторов и архитектур. Мы исследуем эту…
YouTube — PyTorch Official
PyTorch-Native LLM Serving on TPU: SGLang and vLLM
Hi, I'm G from Google. >> I'm Colin from Meta. >> I'm Angela from Meta. >> We are going to be speaking at the PyTorch conference San Jose about new VLM and SG learn engines built on a new PyTorch native TPU backend torch TPU. >> Rather than build a new serving engine or porting…
YouTube — PyTorch Official
Making Weather Forecasts More Accurate
So we know the Earth is getting warmer. We understand climate change at a big picture, but we're struggling to predict the details of what that means for the Earth. NeuralGCM is a new kind of atmospheric model. We feel it has potential to transform how we understand climate.…
YouTube — Google Research
Project Vaani
- In India, we've got 1,300+ languages. There's a saying here, every mile the taste of water changes and every four miles the language changes. - If you travel from one state to another, even one district to another district, you find it difficult to communicate. What will…
YouTube — Google Research
PyTorchCon is where the open source Al community gathers to talk about what we're building together
Hi there. I'm Priya Nagpurkar, VP of AI Native Systems at IBM Research. I'll be at the PyTorch Conference in San Jose, where the open source AI community will gather to talk about what we're all building together. >> [music] >> On Wednesday, October 21st, I'll be giving a…
YouTube — PyTorch Official
DeepSpeed Is Not Just ZeRO: Tensor, Sequence, and Expert Parallelism with ZeRO-Level Usability
Masahiro Tanaka will present “DeepSpeed Is Not Just ZeRO: Tensor, Sequence, and Expert Parallelism with ZeRO-Level Usability” at PyTorch Conference North America 2026. The session will cover DeepSpeed’s AutoTP, AutoSP, and AutoEP capabilities for tensor, sequence, and expert…
YouTube — PyTorch Official
Involved in the AI ecosystem? There's something for everyone at PyTorch Conference North America
Hey folks, my name's Steve. Um, I work at Red Hat in the open source AI programs office and I really want to encourage you to come join us at PyTorch conference in San Jose this year. There's a lot of reasons to go, everything from PyTorch in um, we're going to be doing a…
YouTube — PyTorch Official
Language AI at Google
- Language is core to what it means to be human. It's how we make sense of the world around us and how we relate to one another. It's an expression of identity. Language is not only how we communicate with one another, it's also how we communicate with technology. And while most…
YouTube — Google Research
A Conversation on Language AI
- I wanna start with Google's sort of broader mission of making information more accessible and useful. And for 25 years or so, we've done that, impacting billions of people across the world. What do you see as the future of making information universally accessible and what…
YouTube — Google Research
Can we hear disease before we see it?
Интересно представить, что будущее клинической помощи может заключаться в том, что мы будем слышать, прежде чем видеть. В исследовательском центре Google мы разработали акустические модели для здравоохранения, известные как Here, которые являются базовой моделью. С помощью Here…
YouTube — Google Research
High Performance Serving Framework for Offline and Real-time Diffusion Models - SGLang-Diffusion
SGLang-Diffusion is a high-performance serving framework for diffusion models, designed for both large-scale offline generation and latency-sensitive real-time inference. As diffusion workloads expand from image and video generation to diffusion-based world models, serving…
YouTube — PyTorch Official
High-Velocity GPU Kernel Authoring with CUTLASS Python
Hi everyone. I am Guray, compiler engineer in Nvidia, and I'm going to share our recent improvements to CUTLASS for Python. CUTLASS for Python is our technology stack for writing speed of light kernels for the latest generations of GPUs and can be found under the hood today's…
YouTube — PyTorch Official
MoRI + vLLM: Wide Expert Parallelism and RDMA KV-Cache Transfer for Disaggregated MoE Serving on AMD
Running large Mixture-of-Experts models across pods creates two major challenges: expert dispatch and combine traffic, and moving the KV cache between prefill and decode. At North America 2026, Ravi Gupta, Rishi Madduri, and Shiksha Patel of AMD will present “MoRI + vLLM: Wide…
YouTube — PyTorch Official
AI for Eye Care: A fireside chat on AI in clinical workflows
- So, a few words of introduction. Dr. Kim is the Chief Medical Officer and Director of IT and Systems at Aravind Eye Care System. He pioneer teleophthalmology in India and developed an EMR system used in many eye hospitals. He has been one of our very close collaborators for…
YouTube — Google Research
Using AI to track wildfire boundaries | Chile, February 2024
Using AI to track wildfire boundaries | Chile, February 2024
YouTube — Google Research
Open Buildings: Using AI to put everyone on the map
(gentle music) - [Abigail] Maps tell us where to go, but they are also a lifeline to the things we need. - [Abdoulaye] It's very important to be visible on Maps. We need to know where people live, where are the buildings, especially in informal settlements. That helps with…
YouTube — Google Research
Exchange ideas w/ other devs | on-device AI, inference, voice agents, machine learning compilers...
Hi, I'm Masahiro Hiramoto from Mitsubishi Electric. I'm a member of the program committee for PyTorch conference North America and a PyTorch ambassador. I'm especially looking forward to seeing what people across the community are building with PyTorch and exchanging ideas with…
YouTube — PyTorch Official
Open Source Inference at Production Scale
Hello everyone, I'm Carlos Costa, a distinction engineer here at IBM Research and co-founder of the LMD project. I'll be heading soon to San Jose for PyTorch Conference North America, where I'll have the privilege of sharing some exciting news about LMD. How the project changed…
YouTube — PyTorch Official
Interchangeable KV Importance Signals under One Compiled FlexAttention Budget with FlexBudget
When you run a model over a long context, the KV cache gets huge, so you have to throw some of it away. There are competing rules for choosing what to drop: keep the most recent tokens, keep the ones that get the most attention, and so on. The problem is that every method ships…
YouTube — PyTorch Official