Course Curriculum

    1. Course Overview

    2. LangSmith Background

    3. Getting Set Up

    4. Getting Set Up (Video Guide)

    5. Module 0 Resources

    1. Module 1 Introduction

    2. Module 1 Resources

    3. Lesson 1: Tracing Basics

    4. Lesson 2: Types of Runs

    5. Lesson 3: Alternative Ways to Trace

    6. Lesson 4: Conversational Threads

    7. Module 1 Feedback

    1. Module 2 Introduction

    2. Module 2 Resources

    3. Lesson 1: Datasets

    4. Lesson 2: Evaluators

    5. Lesson 3: Experiments

    6. Lesson 4: Analyzing Experiment Results

    7. [Optional] Lesson 5: Pairwise Experiments

    8. [Optional] Lesson 6: Summary Evaluators

    9. Module 2 Feedback

    1. Module 3 Introduction

    2. Module 3 Resources

    3. Lesson 1: Playground

    4. Lesson 2: Prompt Hub

    5. Lesson 3: Prompt Engineering Lifecycle

    6. Lesson 4: Prompt Canvas

    7. Module 3 Feedback

    1. Module 4 Introduction

    2. Module 4 Resources

    3. Lesson 1: User Feedback

    4. Lesson 2: Annotation Queues

    5. Module 4 Feedback

    1. Module 5 Introduction

    2. Module 5 Resources

    3. Lesson 1: Filtering

    4. Lesson 2: Online Evaluation

    5. Lesson 3: Automations

    6. Lesson 4: Monitoring

    7. Lesson 5: Dashboards

    8. Module 5 Feedback

    9. End of Course Feedback

About this course

  • Free
  • 42 lessons
  • 3.5 hours of video content

LangSmith FAQs

  • Which plan is right for me?

    If you’re an individual developer, the Developer plan is free to get started and a great choice for small projects. For teams that want to self-serve LangSmith, check out the Plus plan. If you need more advanced administration, authentication and authorization, deployment options, support, or annual invoicing, the Enterprise plan is right for you.

  • Where is my data stored?

    When using LangSmith hosted at smith.langchain.com, data is stored in the United States for LangSmith U.S. and The Netherlands for LangSmith E.U. If you’re on the Enterprise plan, we can deliver LangSmith to run on your kubernetes cluster in AWS, GCP, or Azure so that data never leaves your environment.

  • Which security frameworks is LangSmith compliant with?

    We are SOC 2 Type II, HIPAA, and GDPR compliant. We're able to establish a BAA with customers on our Enterprise plan. You can request more information about our security policies and posture at trust.langchain.com.

  • Will you train on the data that I send LangSmith?

    We will not train on your data, and you own all rights to your data. See LangSmith Terms of Service for more information.