Build a Custom AI Tiny LLM from Scratch Using PyTorch

A Complete Guide & Chatbot : Bootcamp to create your own ChatGPT from Scratch
1.00 (1 reviews)
Udemy
platform
English
language
Other
category
Ashutosh Shashi
instructor
Build a Custom AI Tiny LLM from Scratch Using PyTorch
368
students
2 hours
content
Apr 2025
last update
FREE
regular price

What you will learn

Understand the fundamentals of PyTorch and how to use tensors, autograd, modules, and optimizers to build deep learning models from scratch.

Design and implement a word-level tokenizer from scratch, and prepare training data suitable for language modeling tasks.

Build a simplified transformer-based language model (TinyGPT) using PyTorch, including embedding layers, positional encoding, and multi-head attention.

Train your own Tiny LLM on CPU, visualize loss, and fine-tune model performance using techniques like dropout and temperature-based sampling.

Generate text using your trained model, and implement an interactive chatbot that responds to user input via command-line or browser interface.

Gain hands-on experience with language model architecture, training pipeline, text generation, and inference flow — with no need for pre-trained models or GPUs.

Course Gallery

Build a Custom AI Tiny LLM from Scratch Using PyTorch – Screenshot 1
Screenshot 1 – Build a Custom AI Tiny LLM from Scratch Using PyTorch
Build a Custom AI Tiny LLM from Scratch Using PyTorch – Screenshot 2
Screenshot 2 – Build a Custom AI Tiny LLM from Scratch Using PyTorch
Build a Custom AI Tiny LLM from Scratch Using PyTorch – Screenshot 3
Screenshot 3 – Build a Custom AI Tiny LLM from Scratch Using PyTorch
Build a Custom AI Tiny LLM from Scratch Using PyTorch – Screenshot 4
Screenshot 4 – Build a Custom AI Tiny LLM from Scratch Using PyTorch
6578647
udemy ID
20/04/2025
course created date
01/05/2025
course indexed date
Bot
course submited by