Foundation: Building Reliable Agents
Take an agent from first run to production-ready system through iterative cycles of improvement. You’ll learn how to do this with LangSmith, our agent engineering platform for observing and evaluating agents.
Course Introduction
Intro: The Agent Engineering Lifecycle
Getting Set Up - Python (Video)
Getting Set Up - Python (Text)
Getting Set Up - TypeScript (Text)
Language Translation
Glossary and References
Module 1: Introduction
Lesson 1: Observability
Lesson 2: Tracing with LangSmith
Lesson 3: Analyzing your Agent
Module 2: Introduction
Lesson 1: Evaluating Agents
Lesson 2: Creating Datasets
Lesson 3: Running Experiments
Lesson 4: Eval 1 - Code-based Eval
Lesson 5: Eval 2 - LLM-as-Judge
Lesson 6: Eval 3 - Pairwise Evaluations
Module 3: Introduction
Lesson 1: Moving Towards Production
Lesson 2: Insights Agent
Lesson 3: Online Evals
Lesson 4: Automations
Conclusion