IIT Guwahati Campus
IIT Guwahati Emblem
FOUNDATIONS OF LLMS: THEORY AND PRACTICE

AI Education, Made
Accessible to All.

A landmark educational initiative by IIT Guwahati, in strategic collaboration with Kompact AI and Ziroh Labs. A comprehensive 40+ hour course designed to democratise advanced AI and Large Language Model education for students, developers, researchers, and professionals worldwide.

Calendar Launching August 2026
Users Free for Audit
Certification
$12 for Certification
REGISTER INTEREST
ABOUT THE INITIATIVE

IIT Guwahati, together with Kompact AI and Ziroh Labs, presents a first-of-its-kind initiative rooted in the mission of “AI for ALL.”

The program is designed to make high-quality AI education universally accessible by offering the complete course content free of charge to the public through IIT Guwahati’s MOOC platform and YouTube.

Participants seeking formal recognition may opt for an IIT Guwahati Certificate of Participation and Completion through a qualifying examination for a nominal fee of $12 (~₹1200).

What the
Course Covers

A structured and practical introduction to Large Language Models, covering both theoretical foundations and real-world implementation.

01

Foundations of Modern LLM Architectures

  • Transformer Fundamentals
  • State-Space Model (SSM) Fundamentals
02

Modern LLM-Based Application

  • Chat Systems
  • Speech Recognition Systems
  • Vision-Based Systems
  • Mathematical Reasoning Systems
  • Code Generation Systems
03

Transformer Architecture: Deep Dive

  • Self-Attention Mechanisms
  • Self-Attention: Intuition
  • Self-Attention: Mathematical Formulation (Optional)
  • Implementing Self-Attention using Kompact AI
04

Multi-Head Attention (MHA)

  • MHA: Intuition
  • MHA: Mathematical Formulation (Optional)
  • Implementing MHA using Kompact AI
05

Grouped & Multi-Query Attention

  • Grouped Query Attention (GQA)
  • GQA: Mathematical Formulation (Optional)
  • Implementing GQA using Kompact AI
  • GQA Variants (Optional)
  • Multi-Query Attention (MQA): Overview
  • MQA: Mathematical Formulation (Optional)
  • Implementing MQA using Kompact AI
06

Advanced Attention Variants

  • Multi-Latent Attention: Overview
  • Mathematical Formulation (Optional)
  • Implementation of Multi-Latent Attention using Kompact AI
07

Normalization Techniques

  • Role of Normalization
  • Layer Norm: Intuition
  • Layer Norm: Mathematical Formulation (Optional)
  • Implementing Layer Norm using Kompact AI
  • Other Normalisation Methods
08

Multi-Head Attention (MHA)

  • MHA: Intuition
  • MHA: Mathematical Formulation (Optional)
  • Implementing MHA using Kompact AI
09

Output Layer

  • Language Modelling Head (LM Head)
10

Transformer Architectures

  • Encoder Models
  • Decoder Models
  • Encoder-Decoder Models
11

State-Space Models (SSMs)

  • Motivation for SSMs
  • SSM: Intuition
  • SSM: Mathematical Formulation (Optional)
  • Implementing SSM using Kompact AI
12

Building LLM Applications with Kompact AI

  • LLM Construction Pipeline
  • Retrieval-Augmented Generation (RAG) Systems
  • Agentic AI Systems

Taught By

Faculty

Faculty from the Department of Computer Science & Engineering, IIT Guwahati

Scientists

Scientists and AI Practitioners from Ziroh Labs and Kompact AI

Course Format

  • 40+ Hours of Learning
  • Hosted on IIT Guwahati's MOOC Platform
  • Public Audit Access Available Free on YouTube
  • IIT Guwahati Certification
  • Accessible Worldwide

Why This Matters

Advanced AI education should not be limited by access, geography, or cost.

This initiative represents a step toward building a more inclusive AI ecosystem, where students, developers, researchers, and professionals can learn directly from leading academic and industry experts without financial barriers.

Certification

Participants may appear for the qualifying examination to receive:

  • Certificate of Participation
  • Certificate of Completion
Issued by IIT Guwahati  |  Certification Fee: $12 (~₹1200)

Learn the Foundations of Modern AI from Leading Academia and Industry Experts.

Accessible. Practical. Foundational.
Calendar Launching August 2026
Users Free for Audit
Certification $12 for Certification
REGISTER INTEREST