阿斯塔纳时间
AI QAZAQSTANKZ · AI测试版

哈萨克斯坦人工智能与高科技领域的智能门户

← 返回视频中心

YouTube • YouTube — Andrej Karpathy

Let's build the GPT Tokenizer

10月14日

描述

hi everyone so in this video I'd like us to cover the process of tokenization in large language models now you see here that I have a set face and that's because uh tokenization is my least favorite part of working with large language models but unfortunately it is necessary to…