Explore live open-source projects and AI models.

《Build a Large Language Model (From Scratch)》是一本深入探讨大语言模型原理与实现的电子书，适合希望深入了解 GPT 等大模型架构、训练过程及应用开发的学习者。为了让更多中文读者能够接触到这本极具价值的教材，我决定将其翻译成中文，并通过 GitHub 进行开源共享。

Building a GPT-like LLM from scratch with PyTorch.

Build a Large Language Model (From Scratch) book and Finetuned Models

BabyGPT: Build Your Own GPT Large Language Model from Scratch Pre-Training Generative Transformer Models: Building GPT from Scratch with a Step-by-Step Guide to Generative AI in PyTorch and Python

This repository guides you through the process of building a GPT-style Large Language Model (LLM) from scratch using PyTorch. The structure and approach are inspired by the book Build a Large Language Model (From Scratch) by Sebastian Raschka.

An environmental engineering student, fed up with impenetrable textbooks, decided to build a large language model from scratch — to make one worth teaching with.

This repository contains a step-by-step implementation of a ChatGPT-like model from scratch using PyTorch. It covers everything from tokenization and transformer architecture to training and fine-tuning on conversational data. The course is designed for those who want to deeply understand how lar... Read more

In this lecture, we are going to build our own Mini GPT Language Model from scratch using PyTorch! This is a beginner-friendly, step-by-step implementation of a tiny language model that learns to predict the next word, just like how GPT and other Large Language Models work internally.

Build a Large Language Model From Scratch

Educational notebooks that demystify Large Language Models and Computer Vision. We build everything from scratch — from a simple bigram language model to RNNs, LSTMs, Attention, Transformers, CNNs, and Diffusion models (DDPM) — using pure Python and PyTorch. No hype. Just code.