Explore live open-source projects and AI models.

Learn LLM from scratch

🌱 Toprak — Sıfırdan eğitilen, tamamen özgün açık kaynak Türkçe büyük dil modeli. From-scratch Turkish LLM built with PyTorch on Apple Silicon.

Train your own LLM from scratch

A theoretical and practical deep dive into Large Language Models and their applications on Deep learning from scratch.

Implemented LLM from Scratch

From tokenization to transformers — LLMs built from scratch

Collection of notebooks for fine-tuning LLMs from scratch

LLM inference engine built from scratch in C++. No PyTorch, no frameworks.

Simple and easy to understand PyTorch implementation of Large Language Model (LLM) GPT and LLAMA from scratch with detailed steps. Implemented: Byte-Pair Tokenizer, Rotational Positional Embedding (RoPe), SwishGLU, RMSNorm, Mixture of Experts (MOE). Tested on Taylor Swift song lyrics dataset.