Optimize, deploy, and benchmark an open-source LLM with vLLM
I'm thrilled to introduce this course on fast and efficient LLM inference, built in partnership with Red Hat, and taught by Sergey Kliger. Deploying open source LLMs efficiently, so they can serve many users at once with low latency and reasonable cost, is challenging. In this…
- 01.I'm thrilled to introduce this course on fast and efficient LLM inference, built in partnership with Red Hat, and taught by Sergey Kliger
- 02.Deploying open source LLMs efficiently, so they can serve many users at once with low latency and reasonable cost, is challenging
This material is provided as an extended analytical summary.
Read full article at sourceRelated Intelligence
All stories →OpenAI announces three big science discoveries and a new way to work with academics
Less than a month after its mass release of hundreds of manuscripts that it said contained solutions to long-standing mathematics questions, OpenAI is back with three more "major" discoveries in math, computer science, and physics. What's different this time is the choice to…
The New Full-Stack Designer
Today, I'm joined by Marvin Schwaibold, who leads the product design studio at Shopify. He'll give us a behind-the-scenes look at his process, >> [music] >> where we'll see how he's using the latest AI tools to bring his designs to life, then review some viewer-submitted…
Mapping Methane Plumes from Space with AI | Google Research
[Soft piano and strings] Look at these two satellite photos: an oil field, and a valley outside Amman, Jordan. Both look completely empty in visible light, yet in the short-wave infrared, four methane plumes light up. Methane is an infrared thermal blanket: compared to one…