LECTURESSystem Design Skills15

Separate-track curriculum

AI Product Development Curriculum

ChatGPT API, embeddings, RAG

A technical-skill course that, with the final goal of "being able to build a system that combines internal information with AI (RAG) yourself," builds up step by step from the basics of the API to embeddings and Transformers.

AI Product Development Curriculum

─ ARTICLE COVER

System Design SkillsSeparate-track curriculum

§I ─ POSITION

Where this course fits

A technical-skill course in AI product development, independent of the DX-project curriculum. Learn while implementing in Python.

§II ─ TAKEAWAYS

What you will learn

  1. 01

    Call the ChatGPT API and embed it into operations

  2. 02

    Implement the "search" part of RAG with embeddings and semantic search

  3. 03

    Understand the internal workings of the Transformer (attention) hands-on

§III ─ EXCERPT

Excerpt from the course

01

Curriculum structure

A structure of 3 sessions plus a supplement. Build up while implementing.

SessionThemeWhat you do
Session 0IntroductionAn overview of the whole curriculum and the big picture of RAG
Session 1Running the ChatGPT APIPython setup / API calls / basic parameters
Session 2The world of embeddingsVectorizing text / semantic search / implementing the search part of RAG
SupplementHow the Transformer worksExperiencing the attention mechanism

02

Prerequisites

You can take this if you have the basics of Python (if statements / for loops / functions / classes), installing libraries, and basic terminal operations. No experience in web development or machine learning required.

03

How RAG works (covered in Sessions 0 and 2)

RAG (Retrieval-Augmented Generation) is the structure of searching internal documents → including the relevant passages in the LLM's prompt to generate an answer. In Session 2 you implement embeddings + vector search to build the search part. The generation part is an application of the ChatGPT API calls from Session 1.

04

Why we go as far as the Transformer

If you just implement RAG, the Transformer internals aren't needed. But if you can't answer the field's questions — "what is attention?", "where does the context-length limit come from?" — you'll get stuck in AI-product-development decisions. In the supplementary session, you feel out just the key points while running a verification script.

─── Continue in the download edition ───

§∞ ─ DOWNLOAD

Get the full materials, exercises and answers
in the download edition.

─ EXERCISE

Each session has assignments and an instructor's sample answer. The Transformer supplement comes with an experiment-report template and a verification script (transformer_demo.py).

Lecture slides

Every slide of the course

Cheat sheet

Quick reference for the field

Exercises

With answers and grading

Advanced / test

Hands-on plus rubric

IT Consulting Guidebook | A Systematic IT Consulting Method Across 18 Lessons, from IR Analysis to PM | IPLoT Inc.