Ai Engineer Roadmap
⏱ 8 weeks · 👤 Beginner (Zero to Hero) · 📋 AI_ENGINEER
Comprehensive, production-grade learning path for Ai Engineer, architected with foundational-to-advanced pedagogical progression.
Phase 1 Phase 0: Orientation & Mental Models
Establishes the foundational vocabulary and role definition for an AI Engineer. This phase clarifies the distinction between AI, ML, and LLM engineering, setting the stage for technical work by defining responsibilities and impact on product development.
Milestone Introduction to AI Engineering Roles: Crosscutting Concepts in Science and Systems
Crosscutting science concepts: Patterns, Cause & Effect, Scale, Energy & Matter, Systems & Models.
ai models
ULO-CROSSCUTTING_SCIENCE_CONCEPTS · UNIVERSAL · Bloom: Understand
Crosscutting science concepts: Patterns, Cause & Effect, Scale, Energy & Matter, Systems & Models.
Milestone Introduction to AI Engineering Roles: Agent Context and Tool Interchange Standard
Standardized protocol for identifying and providing data context and execution tools to autonomous AI agents, independent of specific platforms.
mcptool useagent interfacelangchain
ULO-MODEL_CONTEXT_PROTOCOL_STANDARD · UNIVERSAL · Bloom: Understand
Standardized protocol for identifying and providing data context and execution tools to autonomous AI agents, independent of specific platforms.
Milestone AI vs ML vs LLM Engineering: Probabilistic vs. Deterministic Reasoning
Analysis of the reasoning differences between deterministic rule-based systems and probabilistic data-driven systems (Data-Driven / Explainable AI).
probabilistic reasoningdeterministic logic
ULO-PROBABILISTIC_VS_DETERMINISTIC_REASONING · UNIVERSAL · Bloom: Understand
Analysis of the reasoning differences between deterministic rule-based systems and probabilistic data-driven systems (Data-Driven / Explainable AI).
Milestone AI vs ML vs LLM Engineering: Large Language Model Principles
Fundamental principles of large language models, including pre-training, instruction tuning, and fine-tuning.
pre-trained modelsfine-tuning
ULO-LARGE_LANGUAGE_MODEL_CONCEPTS · UNIVERSAL · Bloom: Understand
Fundamental principles of large language models, including pre-training, instruction tuning, and fine-tuning.
Milestone The Modern AI Ecosystem Overview: LLM API Integration
Integrating large language models via API: authentication, request/response lifecycle, token limits, rate limiting, retry/backoff, streaming responses, and error handling.
open ai embeddings apicohererate limit
ULO-LLM_API_INTEGRATION · UNIVERSAL · Bloom: Apply
Integrating large language models via API: authentication, request/response lifecycle, token limits, rate limiting, retry/backoff, streaming responses, and error handling.
Milestone The Modern AI Ecosystem Overview: Vector Embedding and Similarity Search
Method of representing text or objects as dense vectors in high-dimensional space and searching for similarity based on spatial distance.
vector databaseschromapinecone
ULO-VECTOR_EMBEDDING_SEARCH · UNIVERSAL · Bloom: Understand
Method of representing text or objects as dense vectors in high-dimensional space and searching for similarity based on spatial distance.
Phase 2 Phase 1: The LLM Core & Prompt Engineering
Focuses on the immediate interaction layer. Learners start with concrete tools (APIs, UIs) to generate text, mastering prompt anatomy, context management, and basic inference mechanics before diving into complex architectures.
Milestone How LLMs Work: Inference & Tokens: Probabilistic Generation Parameters
Designing effective prompts for large language models: system prompts, few-shot examples, chain-of-thought, tuning temperature/top-p, prompt templates, and prompt quality evaluation.
📚 Prerequisites: PROBABILISTIC_VS_DETERMINISTIC_REASONING
temperaturetop-ktop-pinference
ULO-PROMPT_ENGINEERING · UNIVERSAL · Bloom: Apply
Designing effective prompts for large language models: system prompts, few-shot examples, chain-of-thought, tuning temperature/top-p, prompt templates, and prompt quality evaluation.
Milestone Prompt Engineering Fundamentals: AI Prompt Engineering for Code Generation
The learner will be able to design effective prompts to generate accurate and efficient code from AI assistants, including specifying context, constraints, and examples.
📚 Prerequisites: MODEL_CONTEXT_PROTOCOL_STANDARD, LLM_API_INTEGRATION
context specificationchatgptclaudecopilot
ULO-AI_CODE_GENERATION_PROMPTING · UNIVERSAL · Bloom: Apply
The learner will be able to design effective prompts to generate accurate and efficient code from AI assistants, including specifying context, constraints, and examples.
Milestone Context Engineering & Constraints: Retrieval-Augmented Generation
The RAG technique combines generative models with external database retrieval to add real-world context and reduce hallucination.
📚 Prerequisites: VECTOR_EMBEDDING_SEARCH, MODEL_CONTEXT_PROTOCOL_STANDARD
ragvector dbscontext injectiongrounding
ULO-RETRIEVAL_AUGMENTED_GENERATION · UNIVERSAL · Bloom: Understand
The RAG technique combines generative models with external database retrieval to add real-world context and reduce hallucination.
Phase 3 Phase 2: Model Selection & Local Deployment
Expands the toolkit beyond proprietary APIs. Learners explore the spectrum of model types (closed vs. open source), utilize platforms like Hugging Face, and deploy models locally using tools like Ollama and LM Studio to gain control over privacy and cost.
Milestone Choosing the Right Model (Closed vs. Open): Model Checking
The learner will be able to apply model checking to verify that a system satisfies specified properties.
📚 Prerequisites: AI_CODE_GENERATION_PROMPTING
ai safety and ethicsclosed modelsopen source models
ULO-MODEL_CHECKING · UNIVERSAL · Bloom: Analyze
The learner will be able to apply model checking to verify that a system satisfies specified properties.
Milestone Hugging Face Hub & Ecosystem: Cloud Deployment Models
Distinguish cloud deployment models: Public, Private, and Hybrid Cloud.
apis sdks
ULO-CLOUD_DEPLOYMENT_MODELS · UNIVERSAL · Bloom: Apply
Distinguish cloud deployment models: Public, Private, and Hybrid Cloud.
Milestone Local Model Deployment (Ollama/LM Studio): Small Language Model Edge Optimization
Techniques for optimizing and running small language models on microcontrollers and extremely resource-constrained hardware.
slmsmall language modeledge optimizationgemma
ULO-SMALL_LANGUAGE_MODEL_OPTIMIZATION · UNIVERSAL · Bloom: Apply
Techniques for optimizing and running small language models on microcontrollers and extremely resource-constrained hardware.
Phase 4 Phase 3: Knowledge Retrieval (RAG & Embeddings)
Addresses the limitation of static model knowledge. Learners understand vector embeddings, how to store data in Vector Databases, and implement Retrieval-Augmented Generation (RAG) to ground LLM responses in external data sources.
Milestone What are RAGs? (Indexing & Search): Data Chunking and Indexing Strategies
chunkingindexing embeddings
ULO-CHUNKING_STRATEGIES · UNIVERSAL · Bloom: Apply
Milestone Implementing RAG Pipelines: Building Vector Search Pipelines
implementing vector searchpineconelangchain
ULO-IMPLEMENTING_VECTOR_SEARCH · UNIVERSAL · Bloom: Apply
Milestone Implementing RAG Pipelines: Comparative Analysis: RAG vs. Fine-Tuning
rag vs fine-tuning
ULO-RAG_VS_FINE_TUNING · UNIVERSAL · Bloom: Analyze
Phase 5 Phase 4: Agentic Workflows & Multimodal Capabilities
Moves from passive generation to active execution. Learners build AI Agents that can use tools and function calling, integrate multimodal inputs (vision/audio), and orchestrate multi-step reasoning processes.
Milestone AI Agents & Function Calling: Agent Tool Use and Function Calling
The learner will be able to enable an AI agent to call external tools and functions, handle structured inputs and outputs, and incorporate results into an ongoing task following a safe and reliable tool-use loop.
📚 Prerequisites: IMPLEMENTING_VECTOR_SEARCH
function callinglangchainclaude agent sdk
ULO-AGENT_TOOL_USE_FUNCTION_CALLING · UNIVERSAL · Bloom: Understand
The learner will be able to enable an AI agent to call external tools and functions, handle structured inputs and outputs, and incorporate results into an ongoing task following a safe and reliable tool-use loop.
Milestone AI Agents & Function Calling: Structured Output Parsing
Enforcing large language models to return structured output: structured output mode, function calling, schema validation, parse error handling, and retry on invalid responses.
structured outputpydanticjson mode
ULO-STRUCTURED_OUTPUT_PARSING · UNIVERSAL · Bloom: Apply
Enforcing large language models to return structured output: structured output mode, function calling, schema validation, parse error handling, and retry on invalid responses.
Milestone Model Context Protocol (MCP) Basics: Agent Orchestration Patterns
The learner will be able to distinguish and apply patterns for orchestrating multiple agents, such as supervisor-led, peer-to-peer, pipeline, and debate patterns, to build robust multi-agent workflows.
📚 Prerequisites: IMPLEMENTING_VECTOR_SEARCH
multi-agentslangchainhaystackagent orchestration
ULO-AGENT_ORCHESTRATION_PATTERNS · UNIVERSAL · Bloom: Apply
The learner will be able to distinguish and apply patterns for orchestrating multiple agents, such as supervisor-led, peer-to-peer, pipeline, and debate patterns, to build robust multi-agent workflows.
Phase 6 Phase 5: Production Readiness & Observability
Covers the critical 'last mile' of AI engineering. Focuses on evaluating model performance, monitoring latency/cost, ensuring safety against prompt injections, and implementing rigorous regression testing for non-deterministic outputs.
Milestone LLM Evaluations & Regression Testing: Deterministic Evaluation Metrics for LLM Outputs
langsmithexact matchstring similarityunit test
ULO-DETERMINISTIC_EVALUATION_METRICS · UNIVERSAL · Bloom: Apply
Milestone LLM Evaluations & Regression Testing: Regression Testing for AI Pipelines
regression testinglangfuseperformance baselineautomated testing
ULO-REGRESSION_TESTING_IN_AI · UNIVERSAL · Bloom: Analyze
Milestone AI Safety, Ethics & Security Best Practices: Bias Detection and Fairness in AI Systems
bias and fairnessethical aifairness metricstraining data biasresponsible ai
ULO-AI_BIAS_AND_FAIRNESS · UNIVERSAL · Bloom: Analyze