Build a Large Language Model (From Scratch) cover

Build a Large Language Model (From Scratch)

by Sebastian Raschka

Price৳ 250
Price৳ 250

Have a question? Ask on WhatsApp or Message on Messenger

Call 01963 822422 / 01817 506044 for help with your order

Build a Large Language Model (From Scratch) by Sebastian Raschka is a foundational guide to coding a complete generative transformer in pure PyTorch. Rather than treating open-source models as black boxes, this book walks through every architectural component from raw text to text generation. Raschka guides readers through tokenization, multi-head attention, pretraining routines, and instruction fine-tuning.

What you will learn

  • Implement byte-pair encoding tokenization and positional embedding layers from scratch
  • Code multi-head self-attention and causal masking mechanisms in pure PyTorch
  • Assemble the complete transformer architecture matching OpenAI GPT models
  • Train generative language models on custom text data with PyTorch training loops
  • Load pre-trained weights from open models to accelerate custom experiments
  • Fine-tune base language models into conversational instruction followers

Who this is for

Machine learning engineers, researchers, and Python programmers who want a deep, mechanistic understanding of how large language models are constructed. Working knowledge of Python and basic PyTorch syntax is assumed. Advanced deep learning expertise is not required.