YouTube — ISSAI (Nazarbayev University)
Каталог публикаций
Все материалы
Все опубликованные аналитические материалы, исследования суверенного стека, новости экосистемы и обзоры моделей ИИ.
1654
Материалов
База знаний1 мин
Why AI Won't Replace Humans: Insights from Freedom CTO Renat Tukanov
Главный разоблачитель мифов о веб-кодинге в Казахстане. >> На этом, мы будем честны, сейчас много людей пытаются хайпануть. >> И вас это триггерит? >> Будь весел и спокоен, не растерян, когда теряют голову вокруг. Я технооптимист. Веб-кодинг работает. Всё же всё начинается с…
YouTube — Digital Business KZ
База знаний1 мин
Kazakhstani man starts a bumblebee farm and makes billions from it
В террариуме у нас около 200 маток. Они вылетают, чтобы кормить свою семью, но пользу приносит нам. >> Очень много было проблем при транспортировке, потому что нету прямых рейсов. Сначала, когда мы начали, наши клиенты относились недоверием. [музыка] [музыка] Меня зовут…
YouTube — Digital Business KZ
База знаний1 мин
"Over 50% of development will be AI-driven" – an interview with the Deputy Chairman of Halyk Bank
Очень интересный челлендж. Трансформация IT в Халыке в Казахстане. Очень хорошо развиты цифровые [музыка] сервисы для населения, для ритейла. Такое в Европе нет ни у кого. Более 50% того, что мы создаём, будет создаваться с помощью искусственного интеллекта. У нас руководитель…
YouTube — Digital Business KZ
База знаний1 мин
Banks in Kazakhstan to Face New Competition – CAFS 2026: Key Takeaways
вбежать быстрее, получить быстрее лицензию, предложить быстрее какой-то новый продукт, оторвать кусок рынка. >> граница между банками и не банковскими организациями, как это видит регулятор? >> В целом я хотел бы сделать систему менее банкоцентричной. >> Сейчас мы разрабатываем…
YouTube — Digital Business KZ
База знаний1 мин
Kazakhstanis have invented a device that will change how factories operate
На производство первой успешной каски у нас ушло полтора года. На самом деле >> без ИИ вы нам не нужны. >> Ну, значит, две проблем. [смех] Значит, ещё раз. Да, теперь две проблем. [музыка] >> Меня зовут СДыков [музыка] Сакен. Я генеральный директор и соучредитель компании Best…
YouTube — Digital Business KZ
Исследования1 мин
Hugging Face got hacked
hello how's everyone doing today we're going over another set of news that I call the fun category the first one isn't so much fun as it is just interesting and that is a blog post by Wiz research that has compromised hugging Face's entire infrastructure so if you recall one of…
YouTube — Yannic Kilcher
База знаний1 мин
[ML News] Llama 3 changes the game
Hello, hello. We are witnessing the Lama revolution. Um, so today I don't have big fancy intros or anything like this. It's just pretty raw me um, because we have to talk about Lama 3. Lama 3 came out 2 days ago or something like this and it's already mad. It's already all…
YouTube — Yannic Kilcher
Исследования1 мин
Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention
hello there today we're going to look at leave no context behind efficient infinite context Transformers with infinite attention so the specific techniques we're going to look at are called infinite attention and this is by researchers at Google so infinite attention is a…
YouTube — Yannic Kilcher
База знаний1 мин
[ML News] Devin exposed | NeurIPS track for high school students
hey how's everyone doing it's beautiful Monday and this is a few selections of news around the release of llama 3 and 53 uh around these big announcements so some of this stuff is going to be a bit older than that uh but I think it's still cool to check in with what's going…
YouTube — Yannic Kilcher
База знаний1 мин
TransformerFAM: Feedback attention is working memory
hello there today we're going to look at Transformer F feedback attention is working memory by group of researchers out of Google this paper adds what they call feedback attention to Transformers and they do so in an attempt to build a concept of working memory working memory in…
YouTube — Yannic Kilcher
База знаний1 мин
[ML News] Chips, Robots, and Models
hello hello uh today we're going to look at a few happenings in Industry new models new data sets and eval sets coming out and a few new tools that have been released or that could be useful and I just happen to have discovered in the last 2 weeks so first news meta is releasing…
YouTube — Yannic Kilcher
Исследования1 мин
ORPO: Monolithic Preference Optimization without Reference Model (Paper Explained)
hello there today we're looking at orpo monolithic preference optimization without reference model this is a paper by researchers of kaist AI and largely deals with alignment aligning language models and instruction tuned models in some way we'll dive into what that means also I…
YouTube — Yannic Kilcher
Исследования1 мин
[ML News] OpenAI is in hot waters (GPT-4o, Ilya Leaving, Scarlett Johansson legal action)
we have to talk about open AI there's so much been going on in the entire world of AI and today we're going to have a full plate with just open AI I know there's tons of other stuff going on but just open a has been through ups and downs and ups and downs recently and is finding…
YouTube — Yannic Kilcher
База знаний1 мин
xLSTM: Extended Long Short-Term Memory
hello there today we're going to look at xlsm extended long short-term memory by maximilan Beck corbinian Pepple and a team around them especially the corresponding author here is Zep hiter who you may remember was the original or among the original inventors of lstm's long…
YouTube — Yannic Kilcher
Исследования1 мин
Scalable MatMul-free Language Modeling (Paper Explained)
hello everyone today we're going to look at scalable mapol free language modeling by researchers of UC Santa Cruz sucha University UC Davis and Loxy Tech this is a paper that replaces every single matrix multiplication operation inside of large language models with something…
YouTube — Yannic Kilcher
Исследования1 мин
Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools (Paper Explained)
hello there today we're looking at hallucination free assessing the reliability of leading AI legal research tools this is by a set of researchers out of Stanford and Yale as you can see here now I know on this channel we usually look at more kind of core machine learning stuff…
YouTube — Yannic Kilcher
Исследования1 мин
Privacy Backdoors: Stealing Data with Corrupted Pretrained Models (Paper Explained)
Hello, how's everyone doing? I hope you're having a great summer. I am back from vacation and we're ready to dive into some new papers. This paper is called privacy backdoors stealing data with corrupted pre-trained models as by Sean Long Fung and Florian Tramèr of ETH Zurich.…
YouTube — Yannic Kilcher
Исследования1 мин
Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters (Paper)
hello how is everyone doing long time no see today we're going to look at this paper called scaling llm test time compute optimally can be more efficient effective than scaling model parameters this is a collaboration by Google Deep Mind and UC Berkeley and explores the question…
YouTube — Yannic Kilcher
Исследования1 мин
Were RNNs All We Needed? (Paper Explained)
hello today we're going to look at where rnn's all we needed this is a collaboration of Mila and Borealis Ai and puts into question a couple of these modern takes on kind of RNN style parallela trainable models like S4 and Mamba and things like this so they they kind of question…
YouTube — Yannic Kilcher
Исследования1 мин
GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models
hello there today we're going to take a brief look at GSM symbolic understanding of the limitations of mathematical reasoning in large language models this paper is out of apple which uh continues to slowly but surely enter into the research area obviously with uh personal…
YouTube — Yannic Kilcher
Исследования1 мин
Safety Alignment Should be Made More Than Just a Few Tokens Deep (Paper Explained)
hello there today we're going to look at safety alignment should be made more than just a few tokens Deep by Anonymous authors so this is a paper that had been submitted as far as I can tell to eclair is currently on open review and has already gotten reviews and is one of the…
YouTube — Yannic Kilcher
Исследования1 мин
TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters (Paper Explained)
hello there yeah it's cold here um we cannot be dissuaded from reviewing papers today we're going to look at token forer rethinking Transformer scaling with tokenized model parameters this seems to be a collaboration of MOX plunk Institute for informatics Google and picking…
YouTube — Yannic Kilcher
Исследования1 мин
Byte Latent Transformer: Patches Scale Better Than Tokens (Paper Explained)
hello there today we're looking at the paper bite lat and Transformer patches scale better than tokens this paper in a sense does away with classic fixed vocabulary based tokenization and in doing so develops a new architecture called The Bite latent Transformer and in their…
YouTube — Yannic Kilcher
База знаний1 мин
[GRPO Explained] DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
Hello there. Today we're looking at DeepSeekMath, pushing the limits of mathematical reasoning in open language models. Now, this paper is a bit older. Um, it's from, as you can see over here, from the 27th of April, 2024. Nevertheless, it introduces something called GRPO, the…
YouTube — Yannic Kilcher
Исследования1 мин
On the Biology of a Large Language Model (Part 1)
Hello. Today we're taking a look at on the biology of a large language model which is a sort of paper published by anthropic on their kind of series on transformer circuits where they investigate what's going on inside of transformer language models and sort of how do they come…
YouTube — Yannic Kilcher
Исследования1 мин
On the Biology of a Large Language Model (Part 2)
Hello and welcome back to our analysis of on the biology of a large language model by anthropic. This is a blog post that anthropic has published uh investigating what they call the biology of a large language model. This works through uh a technique called attribution graphs.…
YouTube — Yannic Kilcher
Исследования1 мин
Energy-Based Transformers are Scalable Learners and Thinkers (Paper Review)
Hello, how's it going? Today we're going to look at this paper right here. Energy- based transformers are scalable learners and thinkers. This paper combines the uh general concept of energybased models with transformers and suggests a learning paradigm for it and shows how that…
YouTube — Yannic Kilcher
Исследования1 мин
Context Rot: How Increasing Input Tokens Impacts LLM Performance (Paper Analysis)
Hello, today we are looking at context rot how increasing input tokens impacts LLM performance. This paper looks at what happens if with these long context models now we are just sort of putting more and more stuff into the context of LLMs and even though all of these models do…
YouTube — Yannic Kilcher
База знаний1 мин
AGI is not coming!
Hello. I'm out of my usual room today. As you can see, I'm flying to the US for work, but I wanted to give some quick updates on OpenAI's new model launches the past week. So, they've released an open- source model in different variants, and they've also released a new frontier…
YouTube — Yannic Kilcher